-- Logs begin at Mon 2022-10-24 23:39:24 UTC, end at Tue 2022-10-25 00:37:46 UTC. -- Oct 25 00:10:20.852386 dv-osbrick-862542-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 25 00:10:20.861991 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 25 00:10:20 2022] *** Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: nodename: dv-osbrick-862542-1-ceph Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: machine: x86_64 Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: clock source: unix Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: pcre jit disabled Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: detected number of CPU cores: 4 Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: current working directory: / Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: detected binary path: /usr/bin/uwsgi-core Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: your processes number limit is 47680 Oct 25 00:10:20.863737 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: your memory page size is 4096 bytes Oct 25 00:10:20.864430 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: detected max file descriptor number: 2048 Oct 25 00:10:20.864430 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: lock engine: pthread robust mutexes Oct 25 00:10:20.864430 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: thunder lock: enabled Oct 25 00:10:20.864430 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 25 00:10:20.864430 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 25 00:10:20.909880 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: Python main interpreter initialized at 0x5555c73759c0 Oct 25 00:10:20.909880 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: python threads support enabled Oct 25 00:10:20.909880 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: your server socket listen backlog is limited to 100 connections Oct 25 00:10:20.909880 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: your mercy for graceful operations on workers is 90 seconds Oct 25 00:10:20.910288 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: mapped 403077 bytes (393 KB) for 2 cores Oct 25 00:10:20.910288 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: *** Operational MODE: preforking *** Oct 25 00:10:20.910565 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: *** uWSGI is running in multiple interpreter mode *** Oct 25 00:10:20.910565 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: spawned uWSGI master process (pid: 89267) Oct 25 00:10:20.910775 dv-osbrick-862542-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 25 00:10:20.911823 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: spawned uWSGI worker 1 (pid: 89283, cores: 1) Oct 25 00:10:20.911823 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: spawned uWSGI worker 2 (pid: 89284, cores: 1) Oct 25 00:10:20.911976 dv-osbrick-862542-1-ceph devstack@keystone.service[89267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 25 00:10:25.660132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 00:10:25.660132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: from cryptography.utils import int_from_bytes Oct 25 00:10:25.660981 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 00:10:25.660981 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: from cryptography.utils import int_from_bytes Oct 25 00:10:25.661651 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 00:10:25.661651 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: from cryptography.utils import int_from_bytes Oct 25 00:10:25.662156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 00:10:25.662156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: from cryptography.utils import int_from_bytes Oct 25 00:10:25.712066 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 00:10:25.712250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 00:10:25.712439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] command line args: [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 00:10:25.712712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 00:10:25.712893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ================================================================================ {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 00:10:25.713714 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] admin_token = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.713944 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] config_dir = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.714132 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 00:10:25.714231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.714327 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] config_source = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.714418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 00:10:25.714512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] debug = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.714596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] command line args: [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 00:10:25.714693 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.714909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 00:10:25.714972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ================================================================================ {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 00:10:25.715045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] admin_token = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715489 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] config_dir = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.715977 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] config_source = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716268 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] debug = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_config_append = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716461 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_dir = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716865 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_file = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.716929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717185 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717688 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.717931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718155 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_config_append = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718406 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_dir = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718633 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_file = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718708 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.718923 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719642 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719718 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.719943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720296 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720554 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.720886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] publish_errors = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721245 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721555 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.721983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722062 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722255 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] standard_threads = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722474 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] publish_errors = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722762 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722884 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.722968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] use_journal = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] use_json = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723470 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] use_stderr = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723605 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723695 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] use_syslog = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723769 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.723845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] standard_threads = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724103 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.724251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.724499 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724577 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.724679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724765 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.724859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] use_journal = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.724997 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.725083 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] use_json = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.725201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] use_stderr = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.725308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.725415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] use_syslog = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.725521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.725618 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 00:10:25.725806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.725915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726225 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726329 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726428 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.726958 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727323 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727590 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727720 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.727958 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728101 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.728851 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.729485 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.729562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.729771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.729854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730080 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730248 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730334 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730647 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.730876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731017 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731348 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731510 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731760 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.731842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732011 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732094 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732347 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732473 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732831 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.732956 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733067 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733196 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733307 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733443 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733813 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.733914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734285 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734537 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734625 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.734864 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735103 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735256 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735643 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735813 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.735975 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736076 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736300 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736534 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.736996 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737139 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737216 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737612 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737846 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.737928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738078 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738543 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738636 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.738917 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739584 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.739927 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740081 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740321 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740798 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.740886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741056 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741388 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.741909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742288 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742518 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742669 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742811 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742902 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.742977 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743237 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.743943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744030 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744550 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744782 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744931 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.744991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745173 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745436 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745522 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.745935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746015 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746177 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746498 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746744 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.746992 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747227 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747371 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747640 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747877 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.747957 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748432 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.748915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749231 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749306 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749635 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.749878 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750119 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.external = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750580 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750819 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.750970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751482 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.password = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751711 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] auth.token = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.751949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752049 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752271 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752434 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752667 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.752917 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753001 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.external = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753162 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753393 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753485 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753721 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.753965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.password = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] auth.token = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754865 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.754955 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.755949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756189 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756364 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756466 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756618 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756875 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.756961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757119 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757207 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757677 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.757989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758185 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758342 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758575 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.758914 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759151 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759322 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759585 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.759966 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760105 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760356 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760877 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.760967 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761121 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.761907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762040 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762310 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762449 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762449 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762701 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762701 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.762941 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763067 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.763991 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764542 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.764959 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765206 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.765994 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766219 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766468 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766619 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766706 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766860 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.766943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767191 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767507 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.767953 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768358 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768448 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768726 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.768905 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769524 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.769865 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770097 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770492 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770578 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770741 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.770992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771475 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771583 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.771956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772052 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772431 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772904 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.772997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773144 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773229 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773629 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773863 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.773944 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774113 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774601 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774685 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.774919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.775078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.775172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.775311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.775392 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776182 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776364 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776697 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.776953 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777339 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.777947 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778076 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778192 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778421 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778571 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778661 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.778893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779130 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779284 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779557 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779641 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.779920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780422 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.780879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781273 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781514 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781762 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.781845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782241 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782324 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782483 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.782975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783221 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783305 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783813 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.783988 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784081 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784322 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784476 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784804 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.784968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785052 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785205 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] role.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785448 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] role.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.785937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786019 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786188 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786676 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786768 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786916 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.786996 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787401 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] role.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] role.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.787911 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788159 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788410 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788494 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.788907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789001 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789421 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789579 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789659 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.789986 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790086 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790167 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790587 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790822 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.790907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.791075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.791285 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.791380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.791704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.791790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792131 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792396 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792656 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.792915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793010 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793173 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793262 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793495 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793654 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793747 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.793886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794009 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794603 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.794920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795097 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795444 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795614 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795694 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.795951 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796105 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796343 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796579 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.796900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797134 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797385 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797641 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.797883 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798121 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798537 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.connection = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.798852 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799024 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799261 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799349 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799523 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799611 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799762 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.799954 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800102 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800338 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800555 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.800787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801287 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.connection = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801542 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.801938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802189 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802312 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802802 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.802921 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.803041 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.803813 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804080 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 00:10:25.804281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.804898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.805041 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.805464 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 00:10:25.805464 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 00:10:25.833293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.833521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.833755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.835648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.835888 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.836120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.843467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.845916 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.871767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.871931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.872011 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.872093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.926216 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.926920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.976340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.976570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.977478 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:25.977719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.043992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044310 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044473 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044585 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044809 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.044907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.045030 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.045128 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.045250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068479 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068814 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.068932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069118 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069456 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.069894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.081433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.081561 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095321 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095483 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095585 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095709 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095789 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.095996 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.096131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.096223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.096346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.096428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.096578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 00:10:26.113319 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.113525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 00:10:26.113609 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.113770 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 00:10:26.113850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 00:10:26.114134 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114304 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 00:10:26.114386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114583 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.114930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.115101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.115181 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.115365 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.124774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.125064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.125341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.125618 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.126128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.126530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.126807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.127013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.132671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.134083 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.136312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.136574 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.136860 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.137145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.137428 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.137562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.137694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.137853 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.137964 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138142 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138431 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138510 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138786 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.138970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.139051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.139244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.139550 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.139826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.140105 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.140378 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.162053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.163910 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.164054 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.164478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.165845 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.166136 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.170140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.170313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.171275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.171591 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.172373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.173638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.179008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.179250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.183501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.183796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.184082 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.184478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.184751 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.184836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.185058 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.185253 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.185333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.185598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.191530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.191856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.192175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.192601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.192904 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.193198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.193544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.193830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.201734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.202018 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.205917 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.209073 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.209485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.210484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.210790 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.214293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.215985 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.217719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.219269 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.219725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.220868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.221171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.221461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.221866 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.222153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.222450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.224512 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.227944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.232551 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.232886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.233398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.233856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.234172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.234488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.239060 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.239367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.239668 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.239933 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.246897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.248599 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.250135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.250414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.251657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.252006 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.252311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.252592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.253085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.253381 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.253665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.253949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.254232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.259829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.261611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.263184 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.263490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.265582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.265868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.266152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.266251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.266436 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.266527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.266727 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.266819 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.267006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.267106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.267285 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.267383 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.280050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.280375 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.280703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.281035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.281344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.281680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.281988 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.283384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.286462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.289388 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.290828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.292939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.293223 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.293521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.299040 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.300169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.301701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.302367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.304706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.305011 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.305302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.305544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.305680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.307187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.308856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.309187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.309515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.314238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.314569 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.314867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.316777 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.318465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.321739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.322086 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.322399 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.322936 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.323155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.323696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.323696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.323978 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.324253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.324553 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.324830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.325099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.325378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.325647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.325922 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.326203 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.326480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.326758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.332615 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.332937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.333231 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.342906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 00:10:26.343207 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.343724 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.344032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.344333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.344655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.344976 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.345279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.345590 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.345880 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.346159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.346437 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.346733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.347049 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 00:10:26.364248 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555c73759c0 pid: 89284 (default app) Oct 25 00:10:26.365957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4749b-8970-4aa0-9f8e-c187895ee2db None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:26.366246 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4749b-8970-4aa0-9f8e-c187895ee2db None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:26.366519 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4749b-8970-4aa0-9f8e-c187895ee2db None None] PATH_INFO: `/v3` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:26.370882 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Oct 25 00:10:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:26.384844 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555c73759c0 pid: 89283 (default app) Oct 25 00:10:33.903282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:33.903282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:33.903282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:33.903282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:10:33.913920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:33.914610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:33.914610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:33.994079 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: INFO dbcounter [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] Registered counter for database keystone Oct 25 00:10:34.014720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG oslo_db.sqlalchemy.engines [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 00:10:34.022702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writer thread running {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 00:10:34.221382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG passlib.handlers.bcrypt [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89283) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 00:10:34.221778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG passlib.handlers.bcrypt [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89283) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 00:10:34.283290 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:34.284972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:34.427459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 00:10:34.974461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:35.051853 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: INFO dbcounter [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] Registered counter for database keystone Oct 25 00:10:35.075659 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG oslo_db.sqlalchemy.engines [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 00:10:35.083444 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writer thread running {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 00:10:35.207590 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684e152-cd95-4aa6-bb47-487c9ce0803e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:35.212022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:35.212651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:35.212932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:35.213795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:35.223090 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:35.277026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 00:10:35.277283 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f5606-d835-4289-8379-20edd31645c3 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:35.287783 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 25 00:10:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 00:10:35.293899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:35.312531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e127b26-ff35-42ab-b0e6-3ca5cf0a5db4 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:35.317127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:35.318260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:35.318556 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:35.318835 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] PATH_INFO: `/v3/projects/a29ef887000b41b1862f63176946c6ee` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:35.320312 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a29ef887000b41b1862f63176946c6ee)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:35.372461 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 00:10:35.372819 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4c5d3-c2af-42cd-bf0c-c5bac8315be8 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:35.377562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:10:35 2022] GET /identity/v3/projects/a29ef887000b41b1862f63176946c6ee => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:37.848304 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5bcd-e24c-46e0-bc72-15dde66219f5 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:37.848854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5bcd-e24c-46e0-bc72-15dde66219f5 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:37.848854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5bcd-e24c-46e0-bc72-15dde66219f5 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:37.852869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:10:37.858857 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:37.859356 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:37.859477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:37.880184 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:37.881714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:37.890320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 00:10:38.212666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb5bcd-e24c-46e0-bc72-15dde66219f5 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:38.225457 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb5bcd-e24c-46e0-bc72-15dde66219f5 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:38.229829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:38.230440 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:38.230720 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:38.230995 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:38.239291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:38.241126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53dee7-1cdd-47dc-bdb8-bd386eff7e7d admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:38.251437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 25 00:10:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 25 00:10:38.257230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:38.267789 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c3e30-11ec-4a90-ad51-438a34549f6b None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:38.272234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:38.272867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:38.273144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:38.273413 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] PATH_INFO: `/v3/users/1621e081d9274dc6a28173f447bc4436` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:38.274736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=1621e081d9274dc6a28173f447bc4436)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:38.276755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ee6e-0b0c-4b12-864b-807672eca7a5 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:38.278340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 25 00:10:38 2022] GET /identity/v3/users/1621e081d9274dc6a28173f447bc4436 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:40.775716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeced9-7172-4f1b-85c1-4564c35c17e9 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:40.776274 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeced9-7172-4f1b-85c1-4564c35c17e9 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:40.776360 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeced9-7172-4f1b-85c1-4564c35c17e9 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:40.777752 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:40.783980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:40.784497 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:40.784607 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:40.804410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:40.805647 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:40.824623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dcc02-9e76-4156-bfe3-0f093e0c264d None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:40.824914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dcc02-9e76-4156-bfe3-0f093e0c264d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:40.825197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dcc02-9e76-4156-bfe3-0f093e0c264d None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:40.826683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:10:40.833041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:40.833320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:40.833593 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:40.878303 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG passlib.handlers.bcrypt [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89284) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 00:10:40.878812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG passlib.handlers.bcrypt [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89284) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 00:10:40.897567 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:10:40.928687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:40.930296 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:41.036990 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:10:41.224251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.251475 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:41.361081 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.449782 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5f73-7062-49c2-8c39-b4957caffd40 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.467399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273d0d3-e1ac-400f-b8bc-9b8ee8aacb95 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.469738 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:41.485034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.485711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.486003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.486278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.497820 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:41.505697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.506564 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:41.506667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:41.507699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:41.508725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:10:41.509534 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.509534 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.509667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:10:41.509730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.509730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.514499 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.521404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.sql.core [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:10:41.521404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:10:41.521404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [parameters: {'id': '8476c013374947dc9715ca3d1a1c07fc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 00:10:41.521404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:10:41.540122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 00:10:41.541215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application yield resource Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise self.value Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application session.commit() Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 00:10:41.542351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.flush() Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application compat.raise_( Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 00:10:41.543190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 00:10:41.544167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:10:41.545072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [parameters: {'id': '8476c013374947dc9715ca3d1a1c07fc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 00:10:41.546040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:41.546928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 9/15] 10.222.0.18 () {60 vars in 1137 bytes} [Tue Oct 25 00:10:41 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:10:41.548243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.608196 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:41.628224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeea4b-832a-4cd8-b2cc-fde465c5b731 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.651599 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10a3a-2185-4b79-b181-df8a8a073443 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.663476 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.664214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.664492 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.664761 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.665428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:41.665726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.667814 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.679895 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 7/16] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:41.686477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.686890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.687336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.687648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.687917 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.706914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.708432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:10:41.727552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:41.728546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:10:41.729594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:10:41.729594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:10:41.729594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:41.729594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 10/17] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:10:41.734669 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.801688 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b0cc-52e7-455e-8c3c-9c16c2760ffd None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.839638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.840281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.840563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.840839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] PATH_INFO: `/v3/users/1621e081d9274dc6a28173f447bc4436` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.842310 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] RBAC: Authorizing `identity:get_user(user_id=1621e081d9274dc6a28173f447bc4436)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.843830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.845428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 8/18] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/users/1621e081d9274dc6a28173f447bc4436 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:41.851042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:41.866197 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:41.870569 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:41.953185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb339-0aef-4f51-8d8b-aa8bb1c6ab25 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.954256 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971202d-cb2d-4f98-bd26-c6de8b4d67c3 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:41.988178 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.989073 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.989355 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.989630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.990206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:41.990310 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:41.990571 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.990834 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:41.991109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:41.991378 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:41.992002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecd0c4-3901-40af-a09c-9e3c8cdae615 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.992517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:41.993937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:41.996262 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:42.001619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:42.010840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:42.087538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:42.109110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b1dc-de6b-4317-8efb-0abafa9295cc None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:42.145998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:42.146684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:42.146991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:42.147251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] PATH_INFO: `/v3/domains/default/users/1621e081d9274dc6a28173f447bc4436/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:42.149287 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1621e081d9274dc6a28173f447bc4436, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:42.150858 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08385-5926-4ee1-acf0-85bf8e8d46f5 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:42.274651 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 10/21] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Oct 25 00:10:42 2022] PUT /identity/v3/domains/default/users/1621e081d9274dc6a28173f447bc4436/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:10:45.109955 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12730-f4d7-4fd5-bead-ce1856d9c933 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.109955 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12730-f4d7-4fd5-bead-ce1856d9c933 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.109955 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12730-f4d7-4fd5-bead-ce1856d9c933 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.109955 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:45.116276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f80e-f94e-4711-b344-ca934fc7b7fb None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.117145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f80e-f94e-4711-b344-ca934fc7b7fb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.117616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f80e-f94e-4711-b344-ca934fc7b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.144625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-0916f80e-f94e-4711-b344-ca934fc7b7fb None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:45.146506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-0916f80e-f94e-4711-b344-ca934fc7b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:45.223958 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffce3d-2511-4f6d-8c17-6cc29d609639 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.224603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffce3d-2511-4f6d-8c17-6cc29d609639 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.225067 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffce3d-2511-4f6d-8c17-6cc29d609639 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.226845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:45.237031 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.237632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.238120 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.273689 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:45.278377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:45.285110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:45.397278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 25 00:10:45.788135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285dfc-407c-4562-8931-1beb8591a6b0 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.788500 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285dfc-407c-4562-8931-1beb8591a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.788687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285dfc-407c-4562-8931-1beb8591a6b0 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.795515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 12/26] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:45.809566 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:45.815200 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:45.815506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:45.815785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:45.827888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:45.848436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:45.850000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:45.977180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:45.982885 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:10:45.998155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c6a5-a7ce-47e5-9833-266be45df0fa None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:46.046045 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:46.056609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:46.057957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.058958 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.059275 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.060089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:46.061642 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5204e1-7323-4c73-a53d-4638de6f857d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:46.242458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574523-6208-461e-a8ad-c97273241d93 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:46.256940 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 15/28] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 25 00:10:45 2022] POST /identity/v3/roles => generated 219 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:10:46.258557 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e6da-3f9f-4484-9748-d4c04b1d0cca None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.258848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e6da-3f9f-4484-9748-d4c04b1d0cca None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.259126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e6da-3f9f-4484-9748-d4c04b1d0cca None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.261735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 16/29] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:46.267897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.268201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.268464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.287295 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:46.288057 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.288455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.288773 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.300954 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:46.302898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:46.330833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:46.336273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:10:46.386369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:46.387298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:10:46.388198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:10:46.388198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:10:46.388198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:10:46.390332 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 14/30] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:10:46.397140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:46.477692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:46.527923 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:46.534450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 17/31] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:10:46.535585 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:46.558586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f25a-a8bb-4bd9-a523-868615b9c13d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:46.635386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:46.636443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.636899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.637313 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.638240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:46.638691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:46.640491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c7737-37f8-4827-823f-e16348d14354 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:46.663359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:46.664897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ab2c-8e58-4765-87f8-ca3c500afd5d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.665328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ab2c-8e58-4765-87f8-ca3c500afd5d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.665746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ab2c-8e58-4765-87f8-ca3c500afd5d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.668384 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:46.674989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.675507 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.676224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.702989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:46.704652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:46.728470 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1b1c-44b9-4ce3-8ab4-4de69b520dd9 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:46.772873 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:46.773563 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:46.773851 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:46.774127 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:46.776318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:46.776477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:46.802084 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 18/34] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 25 00:10:46 2022] POST /identity/v3/roles => generated 225 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:46.806159 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:46.823563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:10:46.901674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:46.921041 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:46.990241 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992ed9-abfc-4b71-90df-4eefefcd530f None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.016794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.044465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.045861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.046164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.046444 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.047493 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.050387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff9dd3-b3c0-4c4a-91b8-b3780cde5bfc None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.090834 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba7301-b4ba-45f0-869b-6e71d8d9f281 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.092085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 19/36] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:10:46 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:47.093538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc713ad-4adb-4e57-a473-39a1588ed085 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.093829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc713ad-4adb-4e57-a473-39a1588ed085 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.094151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc713ad-4adb-4e57-a473-39a1588ed085 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.100123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 20/37] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:47.102140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.102425 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.102704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.126833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:47.128257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:47.135065 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.135963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.136252 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.136531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.149854 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:47.155690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:47.156658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:10:47.157892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 18/38] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:10:47.163440 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.221013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:47.221986 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.272647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.304077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417194-b2d0-42b5-9a8b-c7d0bfbb0124 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.306089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.343832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fc9e0-6d63-4242-9884-dab992093538 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.352676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.353696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.355095 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.355679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.356608 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:47.357241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.358891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.373050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 19/40] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:47.379745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.394420 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.395336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.395861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.396273 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.397643 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.399316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.402029 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 22/41] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:47.407818 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.524884 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbb674-e8c3-43ef-9060-27096bcb36d2 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.553368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23eebc-c0dd-4057-9dda-2b2456fd3668 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.565578 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.570470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.571393 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.571709 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.571990 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] PATH_INFO: `/v3/users/1621e081d9274dc6a28173f447bc4436` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.574243 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] RBAC: Authorizing `identity:get_user(user_id=1621e081d9274dc6a28173f447bc4436)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.575735 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.578273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 20/42] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:10:47 2022] GET /identity/v3/users/1621e081d9274dc6a28173f447bc4436 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:47.583543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.594663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.595193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.595513 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.595791 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.596545 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.598032 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.621969 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.627967 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 23/43] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:10:47 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:47.628802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.721409 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c18eec-c0bc-4c62-9647-5ff1ed1a4cdb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.762235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062dbb4-c0cb-4d75-85e0-55d74a0ba8aa None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.768126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.768782 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.769073 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.769353 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.770747 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.772293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.774217 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 21/44] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:47.781597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:47.818642 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.819646 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.819932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.820213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.820914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:47.822481 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061796f4-827f-46b5-be1d-a2399a48b3d1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:47.847613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 24/45] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 25 00:10:47 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:47.943369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:47.948869 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc78c-a3d0-4b34-bc31-fbef69dc4708 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:47.997511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:47.998154 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:47.998460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:47.998765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:47.999638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] RBAC: Adding query filter params (role.id=70e01e34b4914943a949ed0ea649288a, scope.domain.id=default, user.id=1621e081d9274dc6a28173f447bc4436) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:47.999978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:48.001490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7590-e155-4c26-90ea-f723a94bcbae None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:48.011765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 22/46] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Oct 25 00:10:47 2022] GET /identity/v3/role_assignments?user.id=1621e081d9274dc6a28173f447bc4436&scope.domain.id=default&role.id=70e01e34b4914943a949ed0ea649288a => generated 530 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:10:50.115488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039212-9094-4225-9427-0799040edbb2 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:50.116009 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039212-9094-4225-9427-0799040edbb2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:50.116092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039212-9094-4225-9427-0799040edbb2 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:50.117365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:50.123779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:50.124233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:50.124319 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:50.143046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:50.144252 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:50.208297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:50.534167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039212-9094-4225-9427-0799040edbb2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:50.560767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:50.639332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039212-9094-4225-9427-0799040edbb2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:50.674870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488289a3-6871-49be-a459-1de176afc905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:50.675555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a3-6871-49be-a459-1de176afc905 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:50.675836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a3-6871-49be-a459-1de176afc905 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:50.676105 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a3-6871-49be-a459-1de176afc905 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:50.677329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488289a3-6871-49be-a459-1de176afc905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:50.678832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488289a3-6871-49be-a459-1de176afc905 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:50.680511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:50.686382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:50.784343 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:50.792152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a39d5f-3d57-447d-9f6e-981271012f7e None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:50.828286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:50.828896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:50.829175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:50.829451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:50.830115 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:50.831620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db502-6c01-4ba1-bdd9-f254c6e59b53 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:50.862520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 24/50] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Oct 25 00:10:50 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:53.258875 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89fb5-f30d-4a4a-81d0-becc9b642f40 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:53.259406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89fb5-f30d-4a4a-81d0-becc9b642f40 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:53.259406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89fb5-f30d-4a4a-81d0-becc9b642f40 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:53.261446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 27/51] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:53.267241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:53.267790 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:53.267874 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:53.287970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:53.289210 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:53.359408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 25/52] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:53.687480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89fb5-f30d-4a4a-81d0-becc9b642f40 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:53.783317 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:53.794734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89fb5-f30d-4a4a-81d0-becc9b642f40 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:53.835946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:53.836609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:53.836893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:53.837169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:53.838376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:53.839939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6de02-9735-4ab4-9cf0-e8c5a774b720 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:53.841923 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 28/53] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:53.847671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:53.928018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:53.953344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c37dd0-a171-4856-bd9e-beeced715c71 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:53.989047 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:53.989677 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:53.989964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:53.990245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:53.990932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:53.992447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b9ac0-aebf-47a8-a69f-bb0e9af5157c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:54.021408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 26/54] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:10:53 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:10:57.721508 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df4521-d1e4-4910-bdf2-5c1ad310ef29 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:57.722019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df4521-d1e4-4910-bdf2-5c1ad310ef29 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:57.722092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df4521-d1e4-4910-bdf2-5c1ad310ef29 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:57.723417 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 29/55] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:57.741184 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e30a1-be15-4c98-a270-f2ba48b2b44f None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:57.741816 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e30a1-be15-4c98-a270-f2ba48b2b44f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:57.741816 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e30a1-be15-4c98-a270-f2ba48b2b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:57.764521 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-3b3e30a1-be15-4c98-a270-f2ba48b2b44f None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:57.765738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-3b3e30a1-be15-4c98-a270-f2ba48b2b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:57.860071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 27/56] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:57.898402 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a607-21ce-44ed-95b4-6dc66d8d5e37 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:57.898718 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a607-21ce-44ed-95b4-6dc66d8d5e37 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:57.898970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a607-21ce-44ed-95b4-6dc66d8d5e37 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:57.900373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 30/57] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:57.907025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:57.907318 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:57.907630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:57.927340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:57.928797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:58.015785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:58.034265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becdaa1-6427-4328-87bd-dc599cf964db None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.034561 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becdaa1-6427-4328-87bd-dc599cf964db None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.034823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becdaa1-6427-4328-87bd-dc599cf964db None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.036240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:10:58.037100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:58.042653 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.043263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.043773 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.078739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:58.080617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:58.182830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 32/60] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:58.257889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.418056 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd159eb-b88f-4c2b-b70b-7460cb15e728 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:58.434678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.490970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:58.491785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.492548 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.493226 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.507895 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:58.513794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:58.514687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:10:58.515477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:10:58.517911 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 29/61] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:10:58.524693 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.603964 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:58.613053 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:58.625437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1dc95-4257-47e0-9380-e8c0f30a1219 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:58.660832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:58.661472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.661753 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.662031 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.664617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7278c8-78af-4370-8cd0-4d2ed3829e17 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:58.673147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-ead8d0ad-a12f-4e29-adae-306824ec9142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:58.679487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:58.680306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:58.681061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 33/62] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:10:58.681889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629c65-8256-4c20-94d4-46c0b1104c76 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.682059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629c65-8256-4c20-94d4-46c0b1104c76 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.682331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629c65-8256-4c20-94d4-46c0b1104c76 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.683755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 34/63] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:58.684293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629c65-8256-4c20-94d4-46c0b1104c76 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.702128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:58.702737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.703021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.703297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.703995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] RBAC: Adding query filter params (name=member) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:58.704299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:58.705693 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337936a-8b47-4b1e-af96-3363e91a3a61 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:58.714163 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 30/64] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:58.715313 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dece0c-61fb-451a-ae92-121f2e4e45f3 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.715624 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dece0c-61fb-451a-ae92-121f2e4e45f3 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.715910 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dece0c-61fb-451a-ae92-121f2e4e45f3 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.717355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 31/65] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:10:58.720218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dece0c-61fb-451a-ae92-121f2e4e45f3 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.790152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629c65-8256-4c20-94d4-46c0b1104c76 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:58.823934 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dece0c-61fb-451a-ae92-121f2e4e45f3 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:58.825490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:58.826314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.826597 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.826875 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.837086 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:58.837591 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-431f9c55-7635-4a51-aaff-ad162cde3acf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:58.842308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:58.843180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:10:58.843965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 35/66] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:10:58.849641 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fec36-e330-4dd5-8f0a-4cabf7baac29 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.849927 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fec36-e330-4dd5-8f0a-4cabf7baac29 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.850207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fec36-e330-4dd5-8f0a-4cabf7baac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.858507 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:58.859109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.859392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.859697 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.860377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:58.860662 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:58.862035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:58.869021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-942fec36-e330-4dd5-8f0a-4cabf7baac29 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:58.870749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-942fec36-e330-4dd5-8f0a-4cabf7baac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:58.871006 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 32/67] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:58.871833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:58.873905 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:58.941341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 36/68] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:58.942608 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:58.942903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:58.943177 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:58.961048 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:10:58.962244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:10:58.977581 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6127df-f59f-4246-8bc6-7c5c14585b94 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.017254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.018011 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.018296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.018572 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.033201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.034766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.035911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 37/69] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:10:59.036672 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.044243 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 33/70] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:10:58 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.045334 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.096302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.117618 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.157799 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8f00-451e-4119-b7d0-2308de9144d2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.183848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660b2a-6362-4ad7-9c8d-a8e0ef08bf5e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.206651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.208084 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.208539 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.209224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.210525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:10:59.211452 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.214596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.233671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 38/71] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.233671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.235226 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.236457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.236935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.238334 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] PATH_INFO: `/v3/users/1621e081d9274dc6a28173f447bc4436` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.239719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] RBAC: Authorizing `identity:get_user(user_id=1621e081d9274dc6a28173f447bc4436)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.241399 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.243753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 34/72] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/users/1621e081d9274dc6a28173f447bc4436 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.245314 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.343022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8f7e-0b77-485a-a247-40ff5c404727 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.374926 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a0c3-6905-4c9c-a904-644de52a2dbb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.375293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.376795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.382152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.382787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.383074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.383352 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.384543 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.386074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.387910 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 39/73] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.388529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.414005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.414637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.414928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.415204 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.416991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.418462 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.420142 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.420921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.494909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9dc-0370-4688-88d4-989fc9f10c84 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.520390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67f646-712c-4c6d-bdc1-7ffef60d9fc8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.528030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.528662 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.528945 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.529219 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.530359 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.531888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.533504 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.534268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.557220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.557891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.558171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.558442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.568639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:10:59.574118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:10:59.575089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:10:59.576015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 36/76] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:10:59.577889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.603658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.611104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.642700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665e6d-b3ad-4e1a-811b-72f42908b814 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.676952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.677576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.677860 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.678132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.679240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.680717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.681491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ffac4-1616-4f16-aa5c-c5bccc25788d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.682801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 41/77] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.683532 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.721221 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.721879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.722169 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.722442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/655bb4b1929d44379b34bd4f0b344b86/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.724511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, user_id=655bb4b1929d44379b34bd4f0b344b86, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.726059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.738742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:10:59 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/655bb4b1929d44379b34bd4f0b344b86/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:10:59.739540 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.801771 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485756b-6ace-46ba-8480-f38460026d0d None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.845651 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.851702 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.852320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.852650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.852893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.854342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.856064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.862564 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 42/79] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:10:59.862747 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1fdb-2f40-4402-915f-c8188a6c37c6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:10:59.862827 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:10:59.862827 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:10:59.904916 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:10:59.905602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:10:59.905889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:10:59.906171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/1621e081d9274dc6a28173f447bc4436/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:10:59.908212 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, user_id=1621e081d9274dc6a28173f447bc4436, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:10:59.909744 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:10:59.926235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 38/80] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:10:59 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/1621e081d9274dc6a28173f447bc4436/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:10:59.927387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:00.000031 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2638-1b5b-4b72-adfe-b46dece50573 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.060198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.061963 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.062762 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.063246 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.064165 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:00.064646 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ad596-b4b8-4db6-921a-1d6a40098820 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.064943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.066884 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.083041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 43/81] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:00.084293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:00.111972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.112597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.112881 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.113164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.113839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.115406 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.143139 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 39/82] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:10:59 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:00.144059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:00.154541 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:00.200965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:00.269734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c9d4-341f-4243-b66f-f9f1f1484214 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.293445 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06845d-4df5-4fbd-8411-65fd99463bbb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.346846 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.348049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.349774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.350223 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/655bb4b1929d44379b34bd4f0b344b86/roles/40565a4609a244fab9756b34ef13211e` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.355464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, user_id=655bb4b1929d44379b34bd4f0b344b86, role_id=40565a4609a244fab9756b34ef13211e)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.356987 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.387681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.388361 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.388644 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.388918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.390455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 44/83] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:00 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/655bb4b1929d44379b34bd4f0b344b86/roles/40565a4609a244fab9756b34ef13211e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:00.390865 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.392363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.394020 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 40/84] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:00 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:00.406258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:00.530809 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8a16-f6c3-4786-b07c-69593361b22a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.559623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:00.573507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.574409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.575036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.575415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] PATH_INFO: `/v3/projects/6593202ac64847c78f796e6a87ae8069` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.576944 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] RBAC: Authorizing `identity:get_project(project_id=6593202ac64847c78f796e6a87ae8069)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.578807 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b983f3-10a6-4610-9e0d-d18762cdd697 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.581288 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 45/85] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:00 2022] GET /identity/v3/projects/6593202ac64847c78f796e6a87ae8069 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:00.588704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:00.698844 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:00.732600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c36b3-94c6-4100-a8fa-85da072b4864 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:00.773220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:00.774257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:00.774746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:00.775223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] PATH_INFO: `/v3/projects/6593202ac64847c78f796e6a87ae8069/users/655bb4b1929d44379b34bd4f0b344b86/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:00.777993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6593202ac64847c78f796e6a87ae8069, user_id=655bb4b1929d44379b34bd4f0b344b86, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:00.779797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cefd96-4fc4-4249-9c53-e7b6986404d2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:00.799252 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:00 2022] PUT /identity/v3/projects/6593202ac64847c78f796e6a87ae8069/users/655bb4b1929d44379b34bd4f0b344b86/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:03.258805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61adb-6b49-4b2e-a5b6-22681264c779 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:03.260599 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61adb-6b49-4b2e-a5b6-22681264c779 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:03.261162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61adb-6b49-4b2e-a5b6-22681264c779 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:03.263193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 46/87] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:03.271633 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9849-8f89-4939-a8f7-72e225d63ed4 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:03.272594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9849-8f89-4939-a8f7-72e225d63ed4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:03.273099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9849-8f89-4939-a8f7-72e225d63ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:03.310237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-c7ab9849-8f89-4939-a8f7-72e225d63ed4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:03.312338 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-c7ab9849-8f89-4939-a8f7-72e225d63ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:03.483683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:03.811871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969de4-3426-4ab6-aeaf-f541d6f19e9e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:03.812718 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969de4-3426-4ab6-aeaf-f541d6f19e9e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:03.813225 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969de4-3426-4ab6-aeaf-f541d6f19e9e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:03.814783 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 47/89] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:03.833069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979498a8-ac00-4a64-97e6-c4a621248b10 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:03.833808 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979498a8-ac00-4a64-97e6-c4a621248b10 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:03.834358 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979498a8-ac00-4a64-97e6-c4a621248b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:03.855678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-979498a8-ac00-4a64-97e6-c4a621248b10 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:03.857234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-979498a8-ac00-4a64-97e6-c4a621248b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:03.934745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:03.948062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 43/90] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:04.029405 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f701-8144-4a52-af5f-4d3974a7a18c None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.029755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f701-8144-4a52-af5f-4d3974a7a18c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.029971 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f701-8144-4a52-af5f-4d3974a7a18c None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.031325 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 48/91] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:04.037167 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.037460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.037745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.064572 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:04.065713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:04.102400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559f701-8144-4a52-af5f-4d3974a7a18c None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.193260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:04.265233 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559f701-8144-4a52-af5f-4d3974a7a18c None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:04.304865 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:04.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.305816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.306092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] PATH_INFO: `/v3/roles/member` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.321383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:04.326959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:04.327950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:04.329030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 49/93] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:04.336141 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.479200 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f4af-8eef-4e52-9010-d13637c962c5 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:04.509284 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:04.523065 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:04.523715 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.524063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.524345 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.525017 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] RBAC: Adding query filter params (name=member) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:04.525375 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:04.528952 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:04.539258 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 45/94] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:04.546478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.624229 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.625337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:04.690989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229b7a-81fa-4cd5-807d-28b3cf70317b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:04.734463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:04.735120 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.735408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.735715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.737329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:04.739142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:04.740844 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 50/95] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:04.748090 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.817215 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b91f5-7239-4780-979b-af2d1280746b None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:04.861152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:04.862312 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.862817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.863289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.868384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68699a-3902-44e0-a33f-8632c7c46ec1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:04.877413 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:04.883502 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:04.884398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:04.885235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:04.893079 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:04.893427 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 46/96] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:04.895663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:04.908574 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:04.909209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:04.909549 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:04.909843 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:04.955978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:04.991380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:04.992927 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f664-11bf-4191-827b-27a67e823336 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.016848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f5abc-1e19-4ea8-9ee1-d3085da5fe04 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.053801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.054460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.054754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.055033 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.067361 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-a66ae6d6-d4e1-4a7e-a998-e3106caa00a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:05.072980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:05.074026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:05.074785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:05.076459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dce8-a20a-468a-84a5-97b3f5290fbe None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.076459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dce8-a20a-468a-84a5-97b3f5290fbe None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.076459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dce8-a20a-468a-84a5-97b3f5290fbe None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.078841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 48/98] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:05.080799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dce8-a20a-468a-84a5-97b3f5290fbe None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.105185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 51/99] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 00:11:05.111212 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f418-8515-4d0c-b6b4-1b7c25cf58aa None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.111531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f418-8515-4d0c-b6b4-1b7c25cf58aa None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.111816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f418-8515-4d0c-b6b4-1b7c25cf58aa None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.113151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 52/100] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:05.114202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186ef5-4805-469e-9b34-53ff440d2b03 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.114517 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186ef5-4805-469e-9b34-53ff440d2b03 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.114761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186ef5-4805-469e-9b34-53ff440d2b03 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.116121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 53/101] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:05.116752 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186ef5-4805-469e-9b34-53ff440d2b03 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.139323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.198925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dce8-a20a-468a-84a5-97b3f5290fbe None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.206071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.228138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186ef5-4805-469e-9b34-53ff440d2b03 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.234498 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.235116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.235405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.235707 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.236370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:05.236673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.238068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3572c-d7cb-40b0-9110-eb8bbdd99910 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.246622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 49/102] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.248034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aeb76-e274-4ccd-88b9-f18f2d13f72a None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.248326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aeb76-e274-4ccd-88b9-f18f2d13f72a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.248600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aeb76-e274-4ccd-88b9-f18f2d13f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.266995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-e31aeb76-e274-4ccd-88b9-f18f2d13f72a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:05.268284 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-e31aeb76-e274-4ccd-88b9-f18f2d13f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:05.269465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.270085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.270375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.270648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.271318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:05.271656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.273051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.286632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 54/103] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.286632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.338672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 50/104] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:05.348964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f852-4e9b-4906-b505-9b84400e9ea1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.349278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f852-4e9b-4906-b505-9b84400e9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.349527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f852-4e9b-4906-b505-9b84400e9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.374525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-8ac4f852-4e9b-4906-b505-9b84400e9ea1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:05.375758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-8ac4f852-4e9b-4906-b505-9b84400e9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:05.378032 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.404995 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdece6b-7c43-4207-801d-cf6d41dbddf1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.453136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.454432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.455152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.455799 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.457862 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 51/105] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:05.458630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.459075 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.459362 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.459676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.462266 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.473804 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 55/106] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.477783 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.484011 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:05.485317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:05.514159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.584014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 52/107] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:05.584672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.695934 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7fb18-8715-415f-bbe5-e95d797e49a3 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.742149 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.742946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.743261 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.743613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.745538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.747202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.749558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 56/108] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.750487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.780338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.797218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d82bd-25c9-4e9e-81e5-1236dab82c9c None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.857680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.858839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.859368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.860044 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] PATH_INFO: `/v3/users/1621e081d9274dc6a28173f447bc4436` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.861541 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] RBAC: Authorizing `identity:get_user(user_id=1621e081d9274dc6a28173f447bc4436)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.863536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.866192 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/users/1621e081d9274dc6a28173f447bc4436 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.868106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:05.884232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752091-255b-4ae1-8b9f-5b630bd1707c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:05.917625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:05.929829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:05.930511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:05.930825 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:05.931140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:05.932593 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] RBAC: Adding query filter params (role.id=9c0837507af34315976055cb8e53ab43, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab, user.id=655bb4b1929d44379b34bd4f0b344b86) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:05.932952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:05.934591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:05.945075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 57/110] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/role_assignments?user.id=655bb4b1929d44379b34bd4f0b344b86&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=9c0837507af34315976055cb8e53ab43 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:05.945075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.026861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe13b-d836-4f6b-9e40-63d2d0defadd None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.071492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.076760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.077488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.077799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.078116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.092549 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:06.098251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:06.099235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:06.100119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:06.104274 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f85d-8ed1-41f5-ac4e-188e9f2e28d7 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.107025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.153123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.154025 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.154458 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.154899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.243246 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.268052 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:06.270508 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:06.272483 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079acb1-ec75-41e1-b223-dcb152fdc46b None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.326804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.327395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.327755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.328031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.366452 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.389764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 58/112] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:06.390637 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.421044 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:06.422921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:06.505739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32dee-32d7-4815-a3d9-acc0ab003315 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.528991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.548556 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 55/113] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:06.549908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.558035 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.558775 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.559098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.559463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.560895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:06.562679 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:06.564665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:06.565667 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.649553 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.721275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d9d6d-9be9-4ef0-94b1-5c079cf92c6e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.731948 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbdbf4-02e8-4f45-9cb3-3659979052c0 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.773532 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.774595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.775100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.776273 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.777511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:06.778067 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:06.779042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:06.779947 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:06.780418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:06.780748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:06.780906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:06.800598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 60/115] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:06.800598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.800908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:06.805917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:06.807089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:06.808114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 56/116] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:06.817382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:06.894804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.968683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d895f5-18d6-4a86-8df6-a3d97265a1d6 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:06.987344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:06.993849 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e43bb6-4645-4bd7-a216-72e12b16b3ca None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.024197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.024966 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.025267 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.025754 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.027360 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.029137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.031349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 61/117] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.032050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.060306 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.061429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.061920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.062443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.064603 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.067490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.077330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 57/118] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:06 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.077330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.175960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f272f2a-671d-47b8-9b68-fb131ce8ea48 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.224322 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.224841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.225124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.225401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.227234 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.228869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.271732 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57c71-7eca-4053-a3a9-edb1678e3ace None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.272018 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 62/119] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:11:07 2022] POST /identity/v3/projects => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:07.272670 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.304586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:07.338267 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:07.345594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.346430 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.346676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.347060 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] PATH_INFO: `/v3/users/ddbfb8318e224201991123ceacd825b7` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.379824 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=ddbfb8318e224201991123ceacd825b7)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.381488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.394197 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/users/ddbfb8318e224201991123ceacd825b7 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.394197 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.476997 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5303c-181a-45ff-8bab-abc3afcde8f4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.538965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.540069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.540610 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.541824 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.543315 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:07.543885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.545610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7e6-8fe4-4d3a-b5ff-79cd30908bb7 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.546780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.563761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.565136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.625681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.626876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.626876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.626876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.628549 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] RBAC: Adding query filter params (role.id=40565a4609a244fab9756b34ef13211e, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab, user.id=655bb4b1929d44379b34bd4f0b344b86) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:07.628549 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.629840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.638796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 59/122] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/role_assignments?user.id=655bb4b1929d44379b34bd4f0b344b86&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=40565a4609a244fab9756b34ef13211e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.640266 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.719533 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:07.750028 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:07.763135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c116f53-05ff-4ca8-82c7-24b530cbf770 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.825823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.826698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.827080 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.827507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.828437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] RBAC: Adding query filter params (role.id=70e01e34b4914943a949ed0ea649288a, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab, user.id=1621e081d9274dc6a28173f447bc4436) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:07.832227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.834139 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.845507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 64/123] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/role_assignments?user.id=1621e081d9274dc6a28173f447bc4436&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=70e01e34b4914943a949ed0ea649288a => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:07.846439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:07.873505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b869fb-9f5f-439d-b3bf-3674627f6582 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:07.983096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:07.984212 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:07.984866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:07.985346 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:07.989357 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:07.992405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:07.997003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 60/124] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:08.006785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:08.011460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951c4f-e846-4beb-95f9-688abb25c553 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:08.065414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:08.065414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:08.065414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:08.065414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] PATH_INFO: `/v3/users/655bb4b1929d44379b34bd4f0b344b86` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:08.065988 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] RBAC: Authorizing `identity:get_user(user_id=655bb4b1929d44379b34bd4f0b344b86)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:08.067591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:08.069691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 65/125] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:07 2022] GET /identity/v3/users/655bb4b1929d44379b34bd4f0b344b86 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:08.077111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:08.124588 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:08.263227 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32617-6f9c-46a6-bbe3-7ef895132664 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:08.268074 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:08.285481 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddeabb-15c4-4122-98e3-99efa10bc17a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:08.329361 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:08.330409 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:08.330865 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:08.331520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/ddbfb8318e224201991123ceacd825b7/roles/c52a273d91bf46cdacb94075999ef5e7` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:08.334709 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, user_id=ddbfb8318e224201991123ceacd825b7, role_id=c52a273d91bf46cdacb94075999ef5e7)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:08.337149 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:08.354639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:08.355278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:08.355697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:08.355895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:08.362838 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 61/126] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:08 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/users/ddbfb8318e224201991123ceacd825b7/roles/c52a273d91bf46cdacb94075999ef5e7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:08.461022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:08.462664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:08.503012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:08.611392 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 66/127] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 00:11:08.620616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:08.765686 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406a6d-9d02-455b-8b88-375936bb7950 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:08.811172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:08.811990 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:08.812321 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:08.812714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] PATH_INFO: `/v3/projects/6593202ac64847c78f796e6a87ae8069` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:08.814285 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=6593202ac64847c78f796e6a87ae8069)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:08.816053 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18abbcd-6c62-4be4-9f0d-5036b232b0e5 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:08.818446 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 62/128] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:08 2022] GET /identity/v3/projects/6593202ac64847c78f796e6a87ae8069 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:08.830731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:08.971340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cec9f-bd1a-47fb-a844-9744b33747f4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:09.010603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:09.028577 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:09.029343 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:09.029695 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:09.030041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:09.031016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] RBAC: Adding query filter params (role.id=9c0837507af34315976055cb8e53ab43, scope.project.id=6593202ac64847c78f796e6a87ae8069, user.id=655bb4b1929d44379b34bd4f0b344b86) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:09.031576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:09.033353 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857d911-a725-450f-beb5-27f64af8da35 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:09.042902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 67/129] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:08 2022] GET /identity/v3/role_assignments?user.id=655bb4b1929d44379b34bd4f0b344b86&scope.project.id=6593202ac64847c78f796e6a87ae8069&role.id=9c0837507af34315976055cb8e53ab43 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:10.214922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3b913-1332-4464-a80d-c0bd33ec3b9b None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:10.215541 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3b913-1332-4464-a80d-c0bd33ec3b9b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:10.215988 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3b913-1332-4464-a80d-c0bd33ec3b9b None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:10.218931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 63/130] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:10.227605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:10.228126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:10.228200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:10.249299 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:10.250526 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:10.330746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 68/131] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:10.662932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3b913-1332-4464-a80d-c0bd33ec3b9b None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:10.713580 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:10.814641 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3b913-1332-4464-a80d-c0bd33ec3b9b None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:10.856127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:10.856813 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:10.857099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:10.857379 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:10.858797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:10.860623 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ccc4d-94e0-4418-9ae8-e1b9246df723 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:10.862472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 64/132] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:10.873552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:11.052961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5e1eb-5d22-41e3-861f-8600d7daa199 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:11.094805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:11.121489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:11.122413 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:11.122904 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:11.123314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:11.124415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:11.127170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617282e-1b0f-4f5e-9cbd-241761998ddb None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:11.164149 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 69/133] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:10 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:11.365969 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d22b0-9b20-49b2-87b2-ed9e1817fbdb None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:11.366469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d22b0-9b20-49b2-87b2-ed9e1817fbdb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:11.366469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d22b0-9b20-49b2-87b2-ed9e1817fbdb None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:11.368104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 65/134] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:11.375181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:11.375734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:11.376192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:11.402025 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:11.403340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:11.492909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 70/135] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:11.934739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d22b0-9b20-49b2-87b2-ed9e1817fbdb None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:12.121171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:12.122112 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d22b0-9b20-49b2-87b2-ed9e1817fbdb None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:12.161504 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:12.162157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:12.162441 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:12.162720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:12.175236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:12.180255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:12.182528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:12.184159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 66/136] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:12.196332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:12.380890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd66bf-ac70-46ee-9a17-c8377f6966b0 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:12.394536 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:12.437042 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:12.437872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:12.438166 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:12.438447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:12.439227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:12.439639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:12.441348 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:12.455611 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 71/137] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:12.471577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:12.622069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30a343-20a0-4b87-a1bf-9aaf1d0d09a1 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:12.662411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:12.663075 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:12.663359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:12.663756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] PATH_INFO: `/v3/users/ddbfb8318e224201991123ceacd825b7` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:12.665020 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ddbfb8318e224201991123ceacd825b7)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:12.666641 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:12.668504 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 67/138] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:12 2022] GET /identity/v3/users/ddbfb8318e224201991123ceacd825b7 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:12.674501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:12.808710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b517-cbba-4349-8223-4628e4f49cbb None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:12.854142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:12.854966 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:12.855252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:12.855557 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:12.896875 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:12.945161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:12.948362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:13.093173 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 00:11:13.099685 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:13.133230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:13.243129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c663-1f24-460d-b75c-9f7a4239d9a7 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:13.283670 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:13.284325 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:13.284613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:13.284891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:13.286084 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:13.287592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ee60-2b4b-49ff-96fc-c59cb11f2b2d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:13.289584 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 68/140] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:13 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:13.295836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:13.377384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:13.419664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1e05-3f83-4065-8b40-9e56e581a959 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:13.458252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:13.458906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:13.459221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:13.459520 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:13.460374 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] RBAC: Adding query filter params (role.id=c52a273d91bf46cdacb94075999ef5e7, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab, user.id=ddbfb8318e224201991123ceacd825b7) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:13.460688 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:13.462287 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46513f-d61c-4706-aece-633ed315edb7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:13.470198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 73/141] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:13 2022] GET /identity/v3/role_assignments?user.id=ddbfb8318e224201991123ceacd825b7&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=c52a273d91bf46cdacb94075999ef5e7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:14.402447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569f0d-5bcb-4313-8418-224125f7146b None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.403405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569f0d-5bcb-4313-8418-224125f7146b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.403405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569f0d-5bcb-4313-8418-224125f7146b None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.404728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 69/142] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:14.409983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8552-41a0-4d35-8d41-dc768f844953 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.410265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8552-41a0-4d35-8d41-dc768f844953 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.410548 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8552-41a0-4d35-8d41-dc768f844953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.411458 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9f62-672f-48b8-a384-1e5f6eaf7b77 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.411969 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9f62-672f-48b8-a384-1e5f6eaf7b77 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.412469 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9f62-672f-48b8-a384-1e5f6eaf7b77 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.415177 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 74/143] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:14.423982 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365c1e-578a-476c-9dd0-1e880f58796b None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.424576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365c1e-578a-476c-9dd0-1e880f58796b None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.424973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365c1e-578a-476c-9dd0-1e880f58796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.439051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-78ef8552-41a0-4d35-8d41-dc768f844953 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:14.441023 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-78ef8552-41a0-4d35-8d41-dc768f844953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:14.448050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-75365c1e-578a-476c-9dd0-1e880f58796b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:14.449465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-75365c1e-578a-476c-9dd0-1e880f58796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:14.528764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 75/144] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:14.552162 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 70/145] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:14.556985 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902581a5-f026-4f1d-85fc-26dea1118025 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.557358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902581a5-f026-4f1d-85fc-26dea1118025 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.557738 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902581a5-f026-4f1d-85fc-26dea1118025 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.559336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 76/146] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:14.565683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:14.566125 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:14.566562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:14.605577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:14.608133 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:14.658369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:14.750442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 71/147] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:14.886049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902581a5-f026-4f1d-85fc-26dea1118025 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:14.962502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.007120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.011161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902581a5-f026-4f1d-85fc-26dea1118025 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.057351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.058005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.058286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.058556 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.073293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:15.079198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:15.080938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:15.082394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 77/148] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:15.086821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.146509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a436a-2e90-4fb2-a4ba-4a8487da8c59 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.198682 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.199602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.199889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.200194 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.212695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:15.218374 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:15.219373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:15.220171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 72/149] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:15.224753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.226026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681940-214f-486e-9a11-eeb56319c993 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.250280 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.254545 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.269239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.270078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.270530 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.270962 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.272109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:15.272640 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.275089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.291777 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 78/150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:15.291777 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.376297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43413a-63e7-4890-8cfc-71970c5ea027 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.417199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66b9f-84ed-4f60-a1ea-8dd3b9f92c86 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.420266 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.422363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.422843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.423298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.425646 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.428269 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.431475 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 73/151] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:15.433462 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.464252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.465129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.465129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.465441 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.466183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:15.466482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.468227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.477588 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 79/152] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:15.478573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.534312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.544457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.563245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea622c-bc36-4514-b812-21f2cfc8455c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.597171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374eaf0-44e1-4736-84f2-c8b3315b41ab None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.607567 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.608201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.608501 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.608754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] PATH_INFO: `/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.623467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2905956b4b16a3bac9d1d4ca1b56)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.625118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.626897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 74/153] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:15.627751 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.635399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.636160 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.636439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.636711 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.637374 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.638860 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.683459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 80/154] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:15 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:15.683459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.758472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2ee2-ed42-46c9-8296-98ae06579ab6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.808460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.809130 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.809472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.809725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] PATH_INFO: `/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.810988 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2905956b4b16a3bac9d1d4ca1b56)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.812566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.814503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 75/155] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:15.820522 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.836613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.843490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dbe72-dc3b-4f74-8658-2151e57699ad None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:15.846662 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:15.897755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:15.899060 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:15.899755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:15.900468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:15.903490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:15.906577 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:15.910249 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 81/156] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:15.917559 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:15.982617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a09af-6697-4b6e-95ed-373cb20c897d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:16.045875 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:16.047050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:16.047728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:16.049031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:16.052648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:16.054855 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:16.059489 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 76/157] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:15 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:16.065247 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:16.100085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579e4d5-8a0a-41b2-ad0d-4cc3e534de38 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:16.172267 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:16.175530 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:16.175770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:16.179725 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/2a9f2905956b4b16a3bac9d1d4ca1b56/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:16.179725 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, user_id=2a9f2905956b4b16a3bac9d1d4ca1b56, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:16.182368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50c332-652d-4e5d-a206-c9a63b240bcf None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:16.213766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:16.223472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 82/158] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:15 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/2a9f2905956b4b16a3bac9d1d4ca1b56/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:11:16.263968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea77b5-15e5-4aee-b1d4-b89a7cde9b63 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:16.339576 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:16.340819 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:16.341246 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:16.342180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/2a9f2905956b4b16a3bac9d1d4ca1b56/roles/40565a4609a244fab9756b34ef13211e` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:16.346677 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, user_id=2a9f2905956b4b16a3bac9d1d4ca1b56, role_id=40565a4609a244fab9756b34ef13211e)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:16.349727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe024d1-5deb-439f-8bcf-3f741a9e5fdd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:16.376275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 77/159] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:16 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/2a9f2905956b4b16a3bac9d1d4ca1b56/roles/40565a4609a244fab9756b34ef13211e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:11:18.523251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8fc9-4930-408b-b8c3-01f75e5cb0e7 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:18.524359 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8fc9-4930-408b-b8c3-01f75e5cb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:18.524849 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8fc9-4930-408b-b8c3-01f75e5cb0e7 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:18.526907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 83/160] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:18.534963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aad37-c8c7-4622-95f2-c7386c190069 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:18.536207 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aad37-c8c7-4622-95f2-c7386c190069 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:18.536800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aad37-c8c7-4622-95f2-c7386c190069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:18.570698 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-924aad37-c8c7-4622-95f2-c7386c190069 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:18.575165 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-924aad37-c8c7-4622-95f2-c7386c190069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:18.697316 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 78/161] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:18.727666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac25c6-73c6-4e16-a246-037d0c36171c None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:18.728208 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac25c6-73c6-4e16-a246-037d0c36171c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:18.729293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac25c6-73c6-4e16-a246-037d0c36171c None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:18.731609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 84/162] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:18.740172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aed80-f40a-4400-8e9f-3c09be7549b4 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:18.740710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aed80-f40a-4400-8e9f-3c09be7549b4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:18.741215 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aed80-f40a-4400-8e9f-3c09be7549b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:18.767415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-856aed80-f40a-4400-8e9f-3c09be7549b4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:18.769344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-856aed80-f40a-4400-8e9f-3c09be7549b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:18.889126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:18.899626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 79/163] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:19.010796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485885-70c5-4d4f-8ac2-a9b343876f12 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.011079 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485885-70c5-4d4f-8ac2-a9b343876f12 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.011442 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485885-70c5-4d4f-8ac2-a9b343876f12 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.013171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 85/164] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:19.019250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409720c4-67ec-4a3c-9625-22b85cf1a1b9 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.019959 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409720c4-67ec-4a3c-9625-22b85cf1a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.020273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409720c4-67ec-4a3c-9625-22b85cf1a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.042684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-409720c4-67ec-4a3c-9625-22b85cf1a1b9 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:19.044438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-409720c4-67ec-4a3c-9625-22b85cf1a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:19.114416 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485885-70c5-4d4f-8ac2-a9b343876f12 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.147109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 80/165] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:19.170995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bb87-5939-4bb7-a9ac-2af68d41b58d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.171398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bb87-5939-4bb7-a9ac-2af68d41b58d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.171700 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bb87-5939-4bb7-a9ac-2af68d41b58d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.172538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:19.173389 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 81/166] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:19.178875 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.179276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.179506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.204639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:19.206000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:19.280351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485885-70c5-4d4f-8ac2-a9b343876f12 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:19.294056 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 82/167] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:19.300404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.333869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:19.335171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.335485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.336023 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.356338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:19.365378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:19.367101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:19.368617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:19.376006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 86/168] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:19.378835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.436669 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:19.529022 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f946d4-4d8d-4603-a5c1-793787495bea None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:19.542166 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:19.560302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a7633-a969-47d1-ad86-adabe6e1ddb8 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:19.592392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:19.593337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.593791 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.594233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.596060 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:19.598391 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:19.601098 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 83/169] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:19.602369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.620999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:19.621751 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.622067 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.622382 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.623342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:19.623870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:19.626314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:19.641194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 87/170] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:19.642652 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.739106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9b21-dc9e-46c6-bd51-47b367f0f2d1 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:19.768184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817c4c-fb7f-48bf-b9ec-776e69c5172e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:19.769071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:19.779251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:19.779929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.780213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.780487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.795571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:19.800681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:19.802038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 84/171] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:19.803296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.815757 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:19.816372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:19.816646 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:19.817233 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:19.817578 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:19.819180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:19.847502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 88/172] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:19 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:19.847502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:19.861886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:19.954597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeccf37-294b-4b71-b6e5-d75333673efa None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.005085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.006028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.006417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.006929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.008021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dcd54-83dc-4cf0-b6a1-1fb6ceea09cf None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.022597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:20.028944 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:20.030109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:20.031100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 85/173] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:20.032035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.064332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.065744 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.066239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.066694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] PATH_INFO: `/v3/users/76b8aa167e7b41de81c371f4967f77ad` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.094221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] RBAC: Authorizing `identity:get_user(user_id=76b8aa167e7b41de81c371f4967f77ad)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.095926 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.097908 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 89/174] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:19 2022] GET /identity/v3/users/76b8aa167e7b41de81c371f4967f77ad => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.098511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.110409 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.195289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfd289-fccc-4ea2-9483-f9edd10a25cc None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.202021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.250328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.252920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.252920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.252920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.253443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:20.253696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.253792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735ac6-38ab-4a7d-b3cb-5b4ebdc691be None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.257172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.269519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 86/175] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.271007 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.314471 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.315180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.315616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.315952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.316724 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:20.317041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.318673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.331739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 90/176] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.339110 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.427265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b8f9b-e287-4b8a-af01-e1a00cad4526 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.439028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.479928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.480594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.480879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.481159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.482358 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.483899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.485607 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 87/177] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.486694 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.515316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1f47e-e21f-447c-8784-5508ffdfd9e5 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.560597 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.573218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.574316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.575181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.575637 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] PATH_INFO: `/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.577522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2905956b4b16a3bac9d1d4ca1b56)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.580388 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.582929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 91/178] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.590587 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.624170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081660dd-31da-4ec4-a6ec-2c5868132a36 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.666527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.667531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.668212 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.668423 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] PATH_INFO: `/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.669908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2905956b4b16a3bac9d1d4ca1b56)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.671879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.674077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 88/179] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/users/2a9f2905956b4b16a3bac9d1d4ca1b56 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:20.682334 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.734255 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e8f7-528f-432d-bea9-4b6284067807 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.752998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.789580 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.790560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.791064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.791625 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/76b8aa167e7b41de81c371f4967f77ad/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.794014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, user_id=76b8aa167e7b41de81c371f4967f77ad, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:20.795813 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:20.823732 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 92/180] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:20 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/76b8aa167e7b41de81c371f4967f77ad/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:20.824925 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:20.844291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7bb0-4261-45fd-89f2-8130ca1ba563 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:20.931507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:20.935658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:20.936565 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:20.936987 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:20.937489 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:20.999785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684c521-5d9e-4ada-a333-34d0ece1f9c9 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:21.049134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:21.050765 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:21.051167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:21.051641 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:21.140731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.142202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:21.154781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.156556 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:21.229927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:21.244513 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:21.321720 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 93/181] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:21.325687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:21.340996 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 89/182] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:21.347693 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:21.503152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48ae9-74d2-4d6c-963b-012ea3048382 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:21.537311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b68a1-bcdf-4664-a7dd-a1214eafd706 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:21.547689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:21.548487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:21.548872 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:21.549248 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:21.550679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.555479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:21.555479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 90/183] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:21 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:21.562319 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:21.600895 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:21.642961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:21.643723 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:21.643920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:21.644199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:21.645359 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.647100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:21.651624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 94/184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:21 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:21.681227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:21.745241 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:21.780412 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278c4a2-f59b-48a7-81d6-3eb01fb56668 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:21.859586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:21.861035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:21.861637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:21.862382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:21.864776 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] RBAC: Adding query filter params (role.id=40565a4609a244fab9756b34ef13211e, scope.project.id=cf75776afbe34a0683dac879dae6d43d, user.id=2a9f2905956b4b16a3bac9d1d4ca1b56) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:21.865606 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.868886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c88530-a50a-4422-bbbb-4390b5ebe3dc None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:21.883510 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 91/185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:21 2022] GET /identity/v3/role_assignments?user.id=2a9f2905956b4b16a3bac9d1d4ca1b56&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=40565a4609a244fab9756b34ef13211e => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:21.930731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243485-1bac-4ce6-b567-cdedc7114a72 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:21.993812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:21.994470 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:21.994741 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:21.995022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:21.995807 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] RBAC: Adding query filter params (role.id=70e01e34b4914943a949ed0ea649288a, scope.project.id=cf75776afbe34a0683dac879dae6d43d, user.id=2a9f2905956b4b16a3bac9d1d4ca1b56) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:21.996112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:21.997573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8695671-35fe-43da-aca6-da0fa974de28 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:22.008417 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 95/186] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:21 2022] GET /identity/v3/role_assignments?user.id=2a9f2905956b4b16a3bac9d1d4ca1b56&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=70e01e34b4914943a949ed0ea649288a => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:22.763037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951af5-ef35-4092-a80e-dccd8bb4c9c9 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:22.763456 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951af5-ef35-4092-a80e-dccd8bb4c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:22.763672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951af5-ef35-4092-a80e-dccd8bb4c9c9 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:22.765135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 92/187] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:22.770479 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:22.771004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:22.771004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:22.789721 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:22.790903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:22.839932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64df6-7235-4534-a557-384837e6c533 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:22.840489 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64df6-7235-4534-a557-384837e6c533 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:22.840581 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64df6-7235-4534-a557-384837e6c533 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:22.842665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 93/188] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:22.848956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:22.849261 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:22.849536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:22.869558 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:22.870861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:22.897414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:22.965871 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 94/190] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:23.249977 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:23.272680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:23.350029 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:23.362654 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:23.379980 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bc0c5-cb16-4b5e-991e-4fcc89caf2e9 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:23.441155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:23.441801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.442079 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.442351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.443681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:23.445153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:23.446757 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:23.454395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:23.487777 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6de9d-ac26-4bed-8bb4-f170aab32e66 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:23.537787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:23.538324 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.538596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.538866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.552736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:23.558752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:23.560235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:23.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:23.565957 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:23.579160 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:23.601709 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a692255-3989-470e-a45b-2f522fcd6c2c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:23.645845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:23.646468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.646748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.647020 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.647781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:23.649278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:23.663157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:23.674748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 98/193] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:23 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:11:23.714618 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044617a-8838-43cf-ae0a-42b74313a63e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:23.762939 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:23.763940 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.764443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.764874 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.765822 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:23.766240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:23.767995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07889b-81c1-4f0d-a490-408a92c73534 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:23.780736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 96/194] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:23.786933 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:23.856748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4fb27-8fdf-4bad-aa5b-9252a3acb366 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.857364 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4fb27-8fdf-4bad-aa5b-9252a3acb366 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.857755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4fb27-8fdf-4bad-aa5b-9252a3acb366 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.860383 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 97/195] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:23.866132 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:23.866526 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:23.866675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:23.887242 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:23.888519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:23.985128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 98/196] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:23.988879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660690c3-1ea6-4dcb-ac9c-6b5b11263c86 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.037287 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.038146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.038605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.039034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] PATH_INFO: `/v3/users/9d7b7ac7944d43e19d14ceb900c60bc9` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.055618 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:24.061669 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7b7ac7944d43e19d14ceb900c60bc9)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:24.062428 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:24.065267 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 99/197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:23 2022] GET /identity/v3/users/9d7b7ac7944d43e19d14ceb900c60bc9 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:24.071712 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:24.162528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:24.221205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab6fe-fbc2-4f18-ba75-a5a9adea54cd None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.261392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.262046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.262329 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.262608 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.263902 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:24.265426 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:24.267107 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 99/198] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:24 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:24.273673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:24.336178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:24.434715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0bd8-4339-4278-b5c9-7943ef44ad63 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.476244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.477575 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.478419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.479306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/9d7b7ac7944d43e19d14ceb900c60bc9/roles/c52a273d91bf46cdacb94075999ef5e7` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.483038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, user_id=9d7b7ac7944d43e19d14ceb900c60bc9, role_id=c52a273d91bf46cdacb94075999ef5e7)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:24.485732 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:24.489820 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f91-a257-474e-9a6e-4df8b4457223 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.506421 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:11:24 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/users/9d7b7ac7944d43e19d14ceb900c60bc9/roles/c52a273d91bf46cdacb94075999ef5e7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:24.538065 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:24.550032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.551068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.551568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.551995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.567718 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:24.575214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:24.576723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:24.578176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:24.579778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:24.589080 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:24.679817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:24.734007 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40ab45-a609-442b-bcaa-46532d182bb2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.776477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.777098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.777382 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.777656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.778340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:24.778644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:24.780082 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:24.793199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:24.800880 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:24.930064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c916-13f7-4028-a47a-003de65cd2fb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:24.975054 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:24.975804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:24.976106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:24.976511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] PATH_INFO: `/v3/users/76b8aa167e7b41de81c371f4967f77ad` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:24.977831 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] RBAC: Authorizing `identity:get_user(user_id=76b8aa167e7b41de81c371f4967f77ad)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:24.980106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:24.981979 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:24 2022] GET /identity/v3/users/76b8aa167e7b41de81c371f4967f77ad => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:24.989286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:25.126687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7aa26-aa95-4ad5-af50-2305a05251cb None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:25.156927 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:25.179704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:25.180722 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:25.181224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:25.182331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:25.265984 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:25.268071 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:25.406032 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 102/203] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:25.412268 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:25.487470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:25.530139 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c13f4-a97d-4827-8357-778235014e5f None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:25.565796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:25.566434 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:25.566717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:25.566983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:25.568161 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:25.569616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7378f-949a-44fc-91d4-68d5afd2cf25 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:25.571781 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:25 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:25.582033 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:25.611835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:25.704529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7d7e-32f6-4270-8a7e-3c64aedefd29 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:25.741135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:25.741752 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:25.742030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:25.742303 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:25.743041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] RBAC: Adding query filter params (role.id=9c0837507af34315976055cb8e53ab43, scope.project.id=cf75776afbe34a0683dac879dae6d43d, user.id=76b8aa167e7b41de81c371f4967f77ad) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:25.743345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:25.745649 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d6c7b-d9fe-4356-bd4f-d00cb0923b0b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:25.752059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:25 2022] GET /identity/v3/role_assignments?user.id=76b8aa167e7b41de81c371f4967f77ad&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=9c0837507af34315976055cb8e53ab43 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:26.669255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58856c-f93e-4453-ba19-b3a914a9643a None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:26.669764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58856c-f93e-4453-ba19-b3a914a9643a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:26.670133 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58856c-f93e-4453-ba19-b3a914a9643a None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:26.672717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 103/206] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:26.681461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684b2a-973c-49fb-8c83-d8988165ad02 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:26.682616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684b2a-973c-49fb-8c83-d8988165ad02 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:26.682984 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684b2a-973c-49fb-8c83-d8988165ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:26.712415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d1684b2a-973c-49fb-8c83-d8988165ad02 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:26.714948 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d1684b2a-973c-49fb-8c83-d8988165ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:26.843476 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 104/207] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:27.172577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58856c-f93e-4453-ba19-b3a914a9643a None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.200522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6681a-c2a0-4a74-ab24-418237e7aaa3 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.200782 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6681a-c2a0-4a74-ab24-418237e7aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.201164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6681a-c2a0-4a74-ab24-418237e7aaa3 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.202700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 105/208] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:27.208683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b881a26-ae31-4ce5-b79a-60facb17ee7f None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.208683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b881a26-ae31-4ce5-b79a-60facb17ee7f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.208959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b881a26-ae31-4ce5-b79a-60facb17ee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.228091 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-6b881a26-ae31-4ce5-b79a-60facb17ee7f None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:27.230456 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-6b881a26-ae31-4ce5-b79a-60facb17ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:27.245899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:27.302159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58856c-f93e-4453-ba19-b3a914a9643a None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.325140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 106/209] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:27.326975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5772-aec5-420d-94d6-fc68937a63d5 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.327568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5772-aec5-420d-94d6-fc68937a63d5 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.327938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5772-aec5-420d-94d6-fc68937a63d5 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.329568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:27.331126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 107/210] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:27.337389 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.337676 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.338658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.355926 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:27.356998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.357484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.357958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.361576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:27.362792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:27.380101 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:27.390547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:27.391925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:27.393036 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 104/211] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:27.398154 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.458724 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 108/212] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:27.536167 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc1787-169f-479f-b70c-f6ee9a3742a4 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.584723 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:27.585348 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.585636 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.585915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.586586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] RBAC: Adding query filter params (name=member) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:27.586889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:27.588931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:27.598701 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 105/213] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:27.605076 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.679328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.703172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:27.739049 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:27.741231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b1ae7-6f6c-4d97-8aaa-12673be58a5a None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.781175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:27.781817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.782182 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.782349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] PATH_INFO: `/v3/users/77b8d761f2b34fafa316d8fe1a6b7272` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.800096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] RBAC: Authorizing `identity:get_user(user_id=77b8d761f2b34fafa316d8fe1a6b7272)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:27.802732 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:27.805089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 109/214] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/users/77b8d761f2b34fafa316d8fe1a6b7272 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:27.806368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.806841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3074-ba5a-4e41-a8a9-874d3a2cd06c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.854850 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:27.855628 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.855914 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.856202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.857367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:27.858870 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:27.860604 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 106/215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:27.861496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.933851 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3e9c-4ac5-4013-9409-b0b625cd2698 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.972498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:27.973140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:27.973413 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:27.973686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:27.975699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:27.983580 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3385-a97e-4c76-9b25-c08fb5256372 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:27.987560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:27.992474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:27.993895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:27.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 110/216] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:27.997142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:27.999377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:28.023905 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:28.024553 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:28.024883 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:28.025160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:28.026108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] RBAC: Adding query filter params (role.id=9c0837507af34315976055cb8e53ab43, user.id=77b8d761f2b34fafa316d8fe1a6b7272, scope.system=all) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:28.026447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:28.028145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:28.033890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 107/217] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 25 00:11:27 2022] GET /identity/v3/role_assignments?user.id=77b8d761f2b34fafa316d8fe1a6b7272&scope.system=all&role.id=9c0837507af34315976055cb8e53ab43 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:28.034760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:28.161906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e6b9e-46d3-4389-8c54-36438641a69c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:28.187004 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ffcd-b5a8-4719-b089-8bd9f309a568 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:28.233768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:28.234784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:28.235263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:28.235472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:28.235825 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:28.236051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:28.236331 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:28.236603 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:28.237034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:28.237282 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] RBAC: Adding query filter params (name=reader) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:28.237584 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:28.239014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:28.239779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:28.250034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:28.255915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:28.273168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 111/219] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:27 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:28.320978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:28.438202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c801-c1eb-4d81-a200-f9f07220290d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:28.486249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:28.486249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:28.486249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:28.488841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] PATH_INFO: `/v3/users/9d7b7ac7944d43e19d14ceb900c60bc9` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:28.490046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7b7ac7944d43e19d14ceb900c60bc9)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:28.491558 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:28.498446 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:28 2022] GET /identity/v3/users/9d7b7ac7944d43e19d14ceb900c60bc9 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:28.499836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:28.570501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:28.651817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2ad5-d5a7-4a87-8d00-be40e63834a7 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:28.704164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:28.705045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:28.705045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:28.705333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:28.814377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:28.817037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:28.892046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:28.962227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:28.970678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:29.108820 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a81a-5e25-4201-9689-b7998f280dd8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:29.117637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:29.158861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:29.159859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:29.160149 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:29.160495 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:29.162681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:29.165241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123a93-b563-4432-b58c-0bc68e988f81 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:29.169509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:28 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:29.179571 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:29.322948 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050607-62cd-4eb9-86c3-50ce50692474 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:29.372998 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:29.373899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:29.374380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:29.374869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:29.375885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] RBAC: Adding query filter params (role.id=c52a273d91bf46cdacb94075999ef5e7, scope.project.id=cf75776afbe34a0683dac879dae6d43d, user.id=9d7b7ac7944d43e19d14ceb900c60bc9) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:29.376512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:29.378206 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce940d4-543b-4ff6-836b-f1a97f39e613 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:29.385992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:11:29 2022] GET /identity/v3/role_assignments?user.id=9d7b7ac7944d43e19d14ceb900c60bc9&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=c52a273d91bf46cdacb94075999ef5e7 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:31.118992 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6f86-e0f9-487a-af06-9c6f6d4e0e89 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.120123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6f86-e0f9-487a-af06-9c6f6d4e0e89 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.120123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6f86-e0f9-487a-af06-9c6f6d4e0e89 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.121711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 111/224] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:31.124807 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a0b-cf4e-4ef2-baf1-5df31ae7cb7e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.125289 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a0b-cf4e-4ef2-baf1-5df31ae7cb7e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.126224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a0b-cf4e-4ef2-baf1-5df31ae7cb7e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.126954 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec8a4-ecb5-4eac-ba8d-49b9f7660a6c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.127234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec8a4-ecb5-4eac-ba8d-49b9f7660a6c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.127540 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec8a4-ecb5-4eac-ba8d-49b9f7660a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.130226 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 114/225] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:31.141020 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef846-22a2-482e-a432-67e418de65cc None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.141615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef846-22a2-482e-a432-67e418de65cc None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.141615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef846-22a2-482e-a432-67e418de65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.148964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-6d3ec8a4-ecb5-4eac-ba8d-49b9f7660a6c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:31.149546 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-6d3ec8a4-ecb5-4eac-ba8d-49b9f7660a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:31.171737 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ac1ef846-22a2-482e-a432-67e418de65cc None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:31.172969 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ac1ef846-22a2-482e-a432-67e418de65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:31.184109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:31.249012 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 112/226] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:31.261351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9639b-dcda-41ac-8c33-ec3561992809 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.261742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9639b-dcda-41ac-8c33-ec3561992809 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.262185 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9639b-dcda-41ac-8c33-ec3561992809 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.264535 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 115/228] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:31.267544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 113/228] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:31.270331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.270673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.270918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.293264 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:31.294456 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:31.395464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 116/229] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:31.605778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9639b-dcda-41ac-8c33-ec3561992809 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:31.610535 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:31.709456 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:31.730416 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9639b-dcda-41ac-8c33-ec3561992809 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:31.734124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:31.738922 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c80610-3be7-4088-ac70-f11ad4c432e5 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:31.776898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:31.777602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.777925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.778108 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:31.778278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.778761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.779043 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.779311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.779811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:31.781388 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:31.783013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:31.783838 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:31.795675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:31.801766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:31.803408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:31.805054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:31.922391 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21027b4-3180-424b-baf8-889b2b7dde43 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:31.936568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363545e-5a57-410f-b6b1-e74be700dba4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:31.964967 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:31.965625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.965898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.966170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.976584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:31.977323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:31.977566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:31.977725 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:31.977942 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] PATH_INFO: `/v3/groups` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:31.978733 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:31.980381 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:31.982645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:31.987703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:31.988900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:31.991231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:32.006197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 118/233] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Oct 25 00:11:31 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:32.007605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:32.030631 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:32.140736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfdb7-8cba-4db6-8508-7717f0c2f031 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.154422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47361a-c92f-4446-a0fc-128954636f0f None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.192238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.193219 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.193503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.193780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.194823 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:32.195658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.197341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.207306 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.208386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.208874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.209475 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 116/234] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:32.209596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.212296 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:32.212639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.215611 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.218804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:32.235538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 119/235] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:32.238051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:32.318811 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:32.368245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:32.375305 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866685-55a5-479e-b788-9da593724eb7 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.385240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deefff-6635-48e9-9197-11398f99f010 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.416414 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.417333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.417652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.418408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] PATH_INFO: `/v3/users/fcf525aaa9df4598984a85489212d31e` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.425121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.425785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.426124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.426396 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] PATH_INFO: `/v3/users/77b8d761f2b34fafa316d8fe1a6b7272` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.434126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] RBAC: Authorizing `identity:get_user(user_id=77b8d761f2b34fafa316d8fe1a6b7272)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.434126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.434126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 120/236] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:32 2022] GET /identity/v3/users/77b8d761f2b34fafa316d8fe1a6b7272 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:32.436962 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:32.443267 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] RBAC: Authorizing `identity:get_user(user_id=fcf525aaa9df4598984a85489212d31e)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.445357 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.448425 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:32 2022] GET /identity/v3/users/fcf525aaa9df4598984a85489212d31e => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:32.457836 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:32.561169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2644cf8-24fc-43ec-8224-a28d6709e287 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.595985 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:32.605016 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab2a00-2915-4993-834e-b407d8db5bdd None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:32.610664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.611454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.611787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.612071 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] PATH_INFO: `/v3/system/users/77b8d761f2b34fafa316d8fe1a6b7272/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.614235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=77b8d761f2b34fafa316d8fe1a6b7272, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.616514 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a52daa-55bb-42d8-bc1c-d0221d8420c6 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.630197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Oct 25 00:11:32 2022] PUT /identity/v3/system/users/77b8d761f2b34fafa316d8fe1a6b7272/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:11:32.654221 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:32.654952 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:32.655277 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:32.655597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:32.656363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] RBAC: Adding query filter params (role.id=c52a273d91bf46cdacb94075999ef5e7, user.id=fcf525aaa9df4598984a85489212d31e, scope.system=all) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:32.656728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:32.658265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc364-ecdf-4e5b-b71f-9fb95dfa682a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:32.667341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 118/239] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 25 00:11:32 2022] GET /identity/v3/role_assignments?user.id=fcf525aaa9df4598984a85489212d31e&scope.system=all&role.id=c52a273d91bf46cdacb94075999ef5e7 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:34.708849 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d19a6-03a9-4002-a464-4774f688976f None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:34.709367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d19a6-03a9-4002-a464-4774f688976f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:34.709367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d19a6-03a9-4002-a464-4774f688976f None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:34.710731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 122/240] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:34.718002 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d27ed-f5ec-4d99-bba3-ce9e5d0e7a18 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:34.718595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d27ed-f5ec-4d99-bba3-ce9e5d0e7a18 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:34.718595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d27ed-f5ec-4d99-bba3-ce9e5d0e7a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:34.738158 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7d8d27ed-f5ec-4d99-bba3-ce9e5d0e7a18 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:34.739736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7d8d27ed-f5ec-4d99-bba3-ce9e5d0e7a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:34.752578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:34.818797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:35.144922 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c6ed-2c2a-4f88-b2f4-ad85e418b5c7 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.145748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c6ed-2c2a-4f88-b2f4-ad85e418b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.145748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c6ed-2c2a-4f88-b2f4-ad85e418b5c7 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.147111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 123/242] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:35.156477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.156953 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.157333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.162871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c6ed-2c2a-4f88-b2f4-ad85e418b5c7 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:35.188817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:35.190018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:35.274713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 120/243] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:35.341235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c6ed-2c2a-4f88-b2f4-ad85e418b5c7 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:35.396865 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:35.397458 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.397764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.398059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.399343 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:35.401064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d373e8-63ff-41d0-98a8-a1afda9b5287 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:35.402902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 124/244] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:35.409499 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:35.409933 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6c2a-c9d5-4629-a2f1-82e592f73147 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.410221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6c2a-c9d5-4629-a2f1-82e592f73147 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.410592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6c2a-c9d5-4629-a2f1-82e592f73147 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.412148 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 125/245] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:35.418995 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.419308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.419639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.440450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:35.441696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:35.509581 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:35.530332 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:35.536719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 126/246] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:35.563659 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb40f-0201-4306-9b00-c2f22515e020 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:35.605885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:35.610728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:35.611728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.612185 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.612666 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] PATH_INFO: `/v3/groups` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.613509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:35.615227 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:35.639021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 121/247] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Oct 25 00:11:35 2022] POST /identity/v3/groups => generated 226 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:11:35.741494 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a157c-9e87-4a41-a0b7-726750d4e8c9 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:35.785345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:35.786012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:35.786293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:35.786563 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:35.799634 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:35.804886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:35.805871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:35.807153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:35.813378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 127/248] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:35.813578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:35.874842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:35.937911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:35.956429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db2a-ddef-449d-b924-8dac5019f117 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.000080 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.000642 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.000924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.001195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.001881 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] RBAC: Adding query filter params (name=member) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:36.002187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.003657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.006710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:36.019869 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 122/249] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:36.026330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:36.029129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e5f3c-cd48-453b-9748-ea0f9380d547 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.079183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.081279 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.082005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.083068 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.105717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:36.109460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:36.110837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:36.112151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:36.123689 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:36.178340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b3d7-0d7d-421e-9126-432e64c0fa06 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.237027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.237678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.237960 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.238232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] PATH_INFO: `/v3/users/77b8d761f2b34fafa316d8fe1a6b7272` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.239463 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] RBAC: Authorizing `identity:get_user(user_id=77b8d761f2b34fafa316d8fe1a6b7272)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.240937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.242812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 123/251] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:36 2022] GET /identity/v3/users/77b8d761f2b34fafa316d8fe1a6b7272 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:36.252497 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:36.260885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051684e-0c9b-4c23-8855-3313aaa382e2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.269158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:36.302475 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.303090 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.303368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.303747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.304463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:36.304765 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.306167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.319480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:36.322254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:36.418595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:36.456202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e5f8-de85-4eea-9b1f-863349260cc2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.468895 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41fd3-c561-43b6-9d5e-27359c31cec6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.500919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.501709 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.502092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.502465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] PATH_INFO: `/v3/users/fcf525aaa9df4598984a85489212d31e` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.504615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf525aaa9df4598984a85489212d31e)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.506144 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.508346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 130/253] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:36 2022] GET /identity/v3/users/fcf525aaa9df4598984a85489212d31e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:36.515141 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:36.515719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.516599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.517092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.517570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.519945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] RBAC: Adding query filter params (role.id=9c0837507af34315976055cb8e53ab43, user.id=77b8d761f2b34fafa316d8fe1a6b7272, scope.system=all) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:36.520496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.522179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65366037-6aca-4889-8bd8-b00df150bf3e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.542003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 124/254] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 25 00:11:36 2022] GET /identity/v3/role_assignments?user.id=77b8d761f2b34fafa316d8fe1a6b7272&scope.system=all&role.id=9c0837507af34315976055cb8e53ab43 => generated 510 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:36.563815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:36.655514 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62af04c-fffe-4dcc-861e-022c3f2de061 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:36.705569 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:36.706698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:36.707251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:36.707789 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] PATH_INFO: `/v3/system/users/fcf525aaa9df4598984a85489212d31e/roles/c52a273d91bf46cdacb94075999ef5e7` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:36.709564 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcf525aaa9df4598984a85489212d31e, role_id=c52a273d91bf46cdacb94075999ef5e7)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:36.711208 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8ffec-954b-468d-bbda-b6e5c95c575f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:36.724108 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 131/255] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Oct 25 00:11:36 2022] PUT /identity/v3/system/users/fcf525aaa9df4598984a85489212d31e/roles/c52a273d91bf46cdacb94075999ef5e7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:11:38.877861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ef8-c98f-4987-b441-31aca07a45d1 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:38.878880 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ef8-c98f-4987-b441-31aca07a45d1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:38.879378 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ef8-c98f-4987-b441-31aca07a45d1 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:38.880973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 125/256] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:38.886784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd3492-3f00-457f-96bf-ce889bd2e8a2 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:38.887741 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd3492-3f00-457f-96bf-ce889bd2e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:38.888224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd3492-3f00-457f-96bf-ce889bd2e8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:38.910989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-b3dd3492-3f00-457f-96bf-ce889bd2e8a2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:38.912841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-b3dd3492-3f00-457f-96bf-ce889bd2e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:38.987541 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 132/257] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 00:11:39.358055 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4ef8-c98f-4987-b441-31aca07a45d1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:39.385584 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4ef8-c98f-4987-b441-31aca07a45d1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:39.385885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313dbc-b25d-4eab-92fe-d94c081cdb76 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.386435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313dbc-b25d-4eab-92fe-d94c081cdb76 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.386905 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313dbc-b25d-4eab-92fe-d94c081cdb76 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.388834 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 133/258] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:39.391447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:39.391447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.391671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.391748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.396868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.397491 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.398019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.404639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:39.412225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:39.413128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:39.413950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 126/259] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 25 00:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:39.422459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:39.434397 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8671d4-db4d-4b18-88d6-506580751e3a admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:39.439100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:39.439908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.440285 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.440656 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.440818 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:39.441505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] RBAC: Adding query filter params (name=member) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:39.441898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:39.442722 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:39.447458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:39.447458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:11:39.447458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:11:39.447458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:39.456826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 127/260] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 25 00:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:39.461256 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:39.462691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 134/261] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 25 00:11:39.472882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af275f2-adbf-4af6-85c4-96f1cf1f5524 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:39.477480 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:39.478200 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.478527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.478943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.485931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:39.487063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:39.487063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:11:39.487063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:11:39.488408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:39.490139 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 128/262] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 25 00:11:39 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:39.496602 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:39.506815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde2b0c-7e74-40fb-9f61-0a086ee855ad None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:39.514225 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:39.515333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.515867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.516341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.517719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:39.520101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4680-2bcf-4caf-92c0-25e3a2d5cef5 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:39.527573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 135/263] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:11:39 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:39.528859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:39.539592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232367b7-3cc0-4da9-a9ec-28da6c830e5d admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:39.544533 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:39.545477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.546025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.546501 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.548721 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, group_id=d1e4e28bb75347aba9dba94f942a7da4, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:39.550010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:39.550010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:11:39.550010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:11:39.552418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f14f-6851-464d-9d30-79d97c766f51 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:39.571903 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 129/264] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 25 00:11:39 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:39.584816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977458-7757-4e2e-9c6d-f15fd84cfdb4 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.585154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977458-7757-4e2e-9c6d-f15fd84cfdb4 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.585376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977458-7757-4e2e-9c6d-f15fd84cfdb4 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.592869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 136/265] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:39.598710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:39.599373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:39.599909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:39.628592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:39.630233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:39.703548 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 130/266] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 00:11:40.174383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977458-7757-4e2e-9c6d-f15fd84cfdb4 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.187938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977458-7757-4e2e-9c6d-f15fd84cfdb4 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.193881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.194513 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.194792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.195061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.209626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:40.216191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:40.217112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:40.218700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 137/267] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:40.223670 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.243481 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529dad-655f-4f36-abbd-2a54d1461ffb None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.253587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.254225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.254507 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.254783 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.255498 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:40.255806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.257637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.275074 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 131/268] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:40.281268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.297221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5838c-2183-44e5-a74e-eb9cc3525281 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.309547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.310214 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.310494 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.310765 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.316295 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.318145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:40.318145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:11:40.318145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:11:40.319403 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 138/269] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:40.327325 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.345122 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343860a-275b-4599-ab7b-54d79256904f admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.355833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.356295 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.356750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.357031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.357307 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.362019 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.363724 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.367655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 132/270] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:40.374788 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343e0f-d181-43c7-8249-1c02f6283a70 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.376220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.380094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.380740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.381071 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.381346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.393666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:40.394062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47902-13ae-48a8-9247-92ebe0e8b0ad admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:40.399218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:40.400175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:40.401959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 139/271] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:40.407184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.410450 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.411156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.411453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.411764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/40565a4609a244fab9756b34ef13211e` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.418315 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd4bd3-acd0-444e-8ca9-f52bebbeefe9 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.420272 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af392eafd77743f7a3eb662cfe9cb9ab, group_id=d1e4e28bb75347aba9dba94f942a7da4, role_id=40565a4609a244fab9756b34ef13211e)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.423061 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.423251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.423847 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.424127 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.424450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.425122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:40.425611 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.426548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:40.426548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:11:40.426548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:11:40.427474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.430247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:40.439417 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 140/272] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:40.448759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.453893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 133/273] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 25 00:11:40 2022] PUT /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/40565a4609a244fab9756b34ef13211e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:11:40.464125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcbc21-89ec-4184-b294-18fba9a86073 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.545065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.545725 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.546005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.546281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.547592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.549665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5325f4-4ee8-4f4a-a3d7-98df2cba4595 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.551660 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 141/274] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:40.557504 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.571782 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:40.584290 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e628c-cf87-4487-889c-9aa5606ee426 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.596625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.597335 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.597626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.597906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.604994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.607258 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.609473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 134/275] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:11:40 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:40.611403 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262d55-7237-478d-a4e7-b7afb57c9043 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.611890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262d55-7237-478d-a4e7-b7afb57c9043 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.612302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262d55-7237-478d-a4e7-b7afb57c9043 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.613863 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 142/276] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:40.619887 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:40.621764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fa05-ec77-4e1c-a7bd-bde05e763db3 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.622245 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fa05-ec77-4e1c-a7bd-bde05e763db3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.622759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fa05-ec77-4e1c-a7bd-bde05e763db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.633224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d51f8a-cae6-4d0b-92cd-5ee587d2bc62 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:40.652488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2590fa05-ec77-4e1c-a7bd-bde05e763db3 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:40.653220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:40.653919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:40.654203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:40.654482 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:40.654618 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2590fa05-ec77-4e1c-a7bd-bde05e763db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:40.660878 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, group_id=d1e4e28bb75347aba9dba94f942a7da4, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:40.663628 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ca63-6029-46ad-ac53-182060fcba49 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:40.668660 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 143/277] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 00:11:40.691906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 135/278] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 25 00:11:40 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:41.019663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00df2e1-57ac-4a31-995e-b6330a1b03e2 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.020145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00df2e1-57ac-4a31-995e-b6330a1b03e2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.020558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00df2e1-57ac-4a31-995e-b6330a1b03e2 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.022330 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 144/279] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:41.028654 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.029086 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.029473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.048972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:41.050312 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:41.122644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00df2e1-57ac-4a31-995e-b6330a1b03e2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.153023 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 136/280] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:41.220088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00df2e1-57ac-4a31-995e-b6330a1b03e2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.229912 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.230818 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.231263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.231712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.248843 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:41.254124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:41.255201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:41.256153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:41.258439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 145/281] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:41.266093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.288622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eff44-51c1-4f96-9d67-13399a23621b None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.297071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.297837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.298257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.298667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.299448 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:41.299917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:41.301775 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:41.317096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 137/282] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:41.322828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.337443 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14aac5-9f43-4bf3-b47f-a2ffb1479c4e admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.347613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.348442 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.348887 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.349312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.350582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:41.352697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:41.355457 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 146/283] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:41.364130 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.386339 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f9d-7e69-46a7-89d0-3bf0edaf5b16 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.392042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.392894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.393267 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.393638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.394987 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:41.397314 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:41.401290 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 138/284] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:41.405192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.423453 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51456146-432d-401d-a67a-79680fa69a74 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.433708 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.434663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.435103 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.435544 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/40565a4609a244fab9756b34ef13211e` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.437943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf75776afbe34a0683dac879dae6d43d, group_id=d1e4e28bb75347aba9dba94f942a7da4, role_id=40565a4609a244fab9756b34ef13211e)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:41.439162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:11:41.439162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:11:41.439162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:11:41.441442 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:41.458681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 147/285] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 25 00:11:41 2022] PUT /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d/groups/d1e4e28bb75347aba9dba94f942a7da4/roles/40565a4609a244fab9756b34ef13211e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:41.679082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.805507 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ac0d-5659-4391-a5fb-293029b2c515 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:41.807886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:41.855169 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:41.855854 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:41.856129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:41.856397 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:41.869719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:41.875234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:41.876220 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:41.877000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 139/286] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:41.888624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:41.983185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:42.040473 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc7ea-3494-48ee-b967-d34020d2a6ba admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:42.084753 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:42.085629 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:42.086083 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:42.086499 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:42.087332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:42.088142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:42.089763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91b227-79e7-4ba5-917b-b2d21287a2c8 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:42.100368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 148/287] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:42.107996 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:42.208639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419889-8500-44fc-bd11-679206174a71 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:42.209140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419889-8500-44fc-bd11-679206174a71 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:42.209538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419889-8500-44fc-bd11-679206174a71 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:42.211305 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 149/288] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:42.220826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:42.221423 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:42.221580 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:42.249234 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:42.250512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:42.256728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca028bb-5f34-46d8-8664-aefc41377b05 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:42.323777 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:42.324407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:42.331451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:42.331451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] PATH_INFO: `/v3/users/fcf525aaa9df4598984a85489212d31e` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:42.331451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] RBAC: Authorizing `identity:get_user(user_id=fcf525aaa9df4598984a85489212d31e)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:42.331451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:42.331829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 25 00:11:42 2022] GET /identity/v3/users/fcf525aaa9df4598984a85489212d31e => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:42.336711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:42.366497 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 150/290] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 25 00:11:42.396843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:42.498372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1b540-6cbd-4bf1-a231-7201b2b4da1f None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:42.548505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:42.549037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:42.549366 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:42.549638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:42.550363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] RBAC: Adding query filter params (role.id=c52a273d91bf46cdacb94075999ef5e7, user.id=fcf525aaa9df4598984a85489212d31e, scope.system=all) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:42.550667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:42.552149 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:42.570627 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 141/291] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 25 00:11:42 2022] GET /identity/v3/role_assignments?user.id=fcf525aaa9df4598984a85489212d31e&scope.system=all&role.id=c52a273d91bf46cdacb94075999ef5e7 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:43.145632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:43.156733 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6872c-eef8-41db-b316-189c367a7601 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:43.168068 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:43.169053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.169609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.170072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.182182 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:43.192036 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:43.192952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:43.193798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:43.196132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 151/292] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 25 00:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:43.202073 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:43.224571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ad67-3a45-4154-910a-f9c10f5ba377 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:43.232859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:43.233497 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.233774 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.234053 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.234744 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:43.235051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:43.236731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:43.255178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 25 00:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:43.261184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:43.278583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c6409-f39c-414d-ae09-effa3aa3ba21 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:43.283530 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:43.284426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.284921 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.285383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] PATH_INFO: `/v3/groups/a050119bf8ad45e08d0f01a9c9a4164b` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.294026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] RBAC: Authorizing `identity:get_group(group_id=a050119bf8ad45e08d0f01a9c9a4164b)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:43.296358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:43.298531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 152/294] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 25 00:11:43 2022] GET /identity/v3/groups/a050119bf8ad45e08d0f01a9c9a4164b => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:43.303787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:43.317426 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c382e-bc63-41ef-a965-4484a5969754 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:43.327678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:43.328373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.328603 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.328877 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] PATH_INFO: `/v3/projects/a29ef887000b41b1862f63176946c6ee` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.336267 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] RBAC: Authorizing `identity:get_project(project_id=a29ef887000b41b1862f63176946c6ee)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:43.338891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33819-d91f-4703-82b0-baa6d7b20f04 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:43.340829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 143/295] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 25 00:11:43 2022] GET /identity/v3/projects/a29ef887000b41b1862f63176946c6ee => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:43.346894 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:43.358220 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f6ef-6a0a-49e7-907b-4986d796bf4c admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:43.380715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:43.381401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.381676 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.381942 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] PATH_INFO: `/v3/projects/a29ef887000b41b1862f63176946c6ee/groups/a050119bf8ad45e08d0f01a9c9a4164b/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.383924 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29ef887000b41b1862f63176946c6ee, group_id=a050119bf8ad45e08d0f01a9c9a4164b, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:43.387392 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98733f-28ba-4b13-94b2-5a7860a4da2b admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:43.408644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 153/296] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 25 00:11:43 2022] PUT /identity/v3/projects/a29ef887000b41b1862f63176946c6ee/groups/a050119bf8ad45e08d0f01a9c9a4164b/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:11:43.921823 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ef3b-419a-4644-a39d-3ef2c0d6994a None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.922148 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ef3b-419a-4644-a39d-3ef2c0d6994a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.922455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ef3b-419a-4644-a39d-3ef2c0d6994a None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.924249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 144/297] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:43.929691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adb38-2a19-458e-820c-6c29ff55f861 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:43.930058 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adb38-2a19-458e-820c-6c29ff55f861 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:43.930340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adb38-2a19-458e-820c-6c29ff55f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:43.957001 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d36adb38-2a19-458e-820c-6c29ff55f861 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:43.958195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d36adb38-2a19-458e-820c-6c29ff55f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:44.004037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:44.046705 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:44.299392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed50d2-d010-47fd-bf72-c9f4f9b7fd3b None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.299761 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed50d2-d010-47fd-bf72-c9f4f9b7fd3b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.300057 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed50d2-d010-47fd-bf72-c9f4f9b7fd3b None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.301407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 145/299] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:44.313966 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e79e-9bba-4501-9833-0a3730ed9ee0 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.314444 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e79e-9bba-4501-9833-0a3730ed9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.314544 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e79e-9bba-4501-9833-0a3730ed9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.336344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-eeb6e79e-9bba-4501-9833-0a3730ed9ee0 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:44.337533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-eeb6e79e-9bba-4501-9833-0a3730ed9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:44.448329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 155/300] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:44.640814 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258524-fa28-4cda-b83f-a744c259735e None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.641300 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258524-fa28-4cda-b83f-a744c259735e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.641300 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258524-fa28-4cda-b83f-a744c259735e None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.642975 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 146/301] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:44.662566 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e8c1-e252-4b30-8b27-5db97f3681df None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.663070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e8c1-e252-4b30-8b27-5db97f3681df None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.663589 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e8c1-e252-4b30-8b27-5db97f3681df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.692967 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258524-fa28-4cda-b83f-a744c259735e None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:44.702839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d349e8c1-e252-4b30-8b27-5db97f3681df None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:44.703629 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d349e8c1-e252-4b30-8b27-5db97f3681df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:44.801242 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:44.840362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 156/302] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:44.852490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a0c6-c673-4b82-814f-0afc33af727d None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.853702 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a0c6-c673-4b82-814f-0afc33af727d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.854185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a0c6-c673-4b82-814f-0afc33af727d None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.856329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 157/303] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:44.861802 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258524-fa28-4cda-b83f-a744c259735e None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:44.863344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5bc9-542b-4378-b494-276706047c52 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.865373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5bc9-542b-4378-b494-276706047c52 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.865872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5bc9-542b-4378-b494-276706047c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.911295 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-adec5bc9-542b-4378-b494-276706047c52 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:44.912858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-adec5bc9-542b-4378-b494-276706047c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:44.945529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:44.962274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:44.963504 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:44.963847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:44.963847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:44.985745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:44.992922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:44.993843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:44.994727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:44.998360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 147/304] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:44.999746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.015188 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 158/305] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:45.020096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5bc9-542b-4378-b494-276706047c52 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.145453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914c86-5d0b-4199-8bcd-145fd1f83bb5 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.154895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5bc9-542b-4378-b494-276706047c52 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.190517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.191202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.191737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.191913 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.195075 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.207063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:45.208121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.208959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.209420 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.209871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.210758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:45.211257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:45.212696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:45.213803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:45.214719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 148/306] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:45.216143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:45.224212 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.233681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 159/307] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:45.237554 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.277852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.379547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3a01-9925-47af-8f95-09c0570a20e5 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.383055 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61cf8-fa66-47a4-9596-4502ef229ff0 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.424286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.425259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.425742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.426240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.427119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:45.427681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:45.429303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:45.430980 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.432164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.432445 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.432713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.447570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 149/308] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:45.447570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.512923 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.525068 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:45.528051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:45.561691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.588570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e1808-1ff5-48d5-b7f8-1247a2253571 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.638779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.639452 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.639750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.640026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] PATH_INFO: `/v3/roles/member` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.652076 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:45.658363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:45.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:45.660177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 150/309] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:45.660839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.676759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 160/310] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 00:11:45.678511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.797492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa3c4-85a6-4f2e-984f-9903e7748b01 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.804048 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1592-b214-4a1a-b75d-496dcfd9307b None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:45.829074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.830695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:45.852237 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.852831 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:45.852957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.853141 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.853994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:45.854124 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.854289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:45.854560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:45.866057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:45.871281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:45.872276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 00:11:45.873069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:45.875937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 161/311] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:45.875937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:45.960377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:45.961968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.015941 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6817-9884-4434-8ce5-24f0853cc520 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.066685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.066939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.067181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.067482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.068157 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:46.068529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.071316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.080795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 162/312] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.081644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.098394 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 151/313] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:46.099263 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.130035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.143249 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.222885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6637581-17e8-479d-9479-226c99f8e1e1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.239597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab90fb4-2254-44a1-88c9-1681074f89ed None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.275014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.276181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.276458 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.276723 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.278027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.279496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.281713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 163/314] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.282550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.292601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.293463 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.293463 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.293665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.294292 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:46.294591 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.296127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.311816 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 152/315] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.312870 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.418787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751da5a-f00d-43fb-97ee-62157c44762c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.432341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.437076 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.457897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc4ce3-c841-4b64-99e5-10845bb3585a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.461044 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.461666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.461946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.462219 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.496935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.497568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.497851 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.498129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] PATH_INFO: `/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.499259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] RBAC: Authorizing `identity:get_project(project_id=af392eafd77743f7a3eb662cfe9cb9ab)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.500754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.502571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 153/316] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/projects/af392eafd77743f7a3eb662cfe9cb9ab => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.503243 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.534930 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.536432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.608528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4a39f-58fc-42be-abe4-2c792eb278b3 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.645748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.646289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.646565 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.646833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.647970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.649423 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.652227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 164/317] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:46.657278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 154/318] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.657278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.657785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.671738 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.676178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.761963 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6f14-dfc6-4657-8034-add9213f134c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.762706 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473859c-40da-47ff-877c-d5b43a438c64 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.796034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.796660 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.796798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.796941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.797206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.797405 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.797688 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.797962 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.798301 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.799794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.801363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 155/319] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.802116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.866453 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.868115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa760094-0fd8-414b-84fa-1a8856f8505c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.883228 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.888998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:46.908949 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ab89-877c-41b3-a887-9f2d0f2c2093 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:46.942298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:46.942928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.943206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.943505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.944624 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:46.946075 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:46.947897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 156/320] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:46.948664 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:46.976621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 165/321] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:46.978137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0efd-c756-4746-9009-1fc805b5c098 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:46.979049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0efd-c756-4746-9009-1fc805b5c098 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:46.979338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0efd-c756-4746-9009-1fc805b5c098 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:46.980617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 166/322] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:46.981320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0efd-c756-4746-9009-1fc805b5c098 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.055640 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b1f-41ce-4408-8a25-a1f7e8953228 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.083858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0efd-c756-4746-9009-1fc805b5c098 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.089736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.090422 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.090741 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.091013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.091772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] RBAC: Adding query filter params (group.id=d1e4e28bb75347aba9dba94f942a7da4, role.id=9c0837507af34315976055cb8e53ab43, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:47.092076 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.093897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.101987 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:47.108557 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 157/323] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/role_assignments?group.id=d1e4e28bb75347aba9dba94f942a7da4&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=9c0837507af34315976055cb8e53ab43 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.109402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.131162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.132300 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.132604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.132881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.134269 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] RBAC: Adding query filter params (group.id=d1e4e28bb75347aba9dba94f942a7da4, role.id=40565a4609a244fab9756b34ef13211e, scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:47.134560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.136616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.137528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:47.155467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 167/324] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 25 00:11:46 2022] GET /identity/v3/role_assignments?group.id=d1e4e28bb75347aba9dba94f942a7da4&scope.project.id=af392eafd77743f7a3eb662cfe9cb9ab&role.id=40565a4609a244fab9756b34ef13211e => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.155467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.301985 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce380b0-244e-477b-a265-3cc3854ee8ef None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.305894 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512508-00d5-4bed-864d-c7c8c70ea620 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.355047 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.355386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.356086 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.356363 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.356615 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.356714 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] PATH_INFO: `/v3/projects/cf75776afbe34a0683dac879dae6d43d` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.357259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.357729 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.357933 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] RBAC: Authorizing `identity:get_project(project_id=cf75776afbe34a0683dac879dae6d43d)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.359350 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.359586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4c7c4-62f4-4ee1-9a2e-d6dba1618396 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.361272 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.361576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 168/325] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/projects/cf75776afbe34a0683dac879dae6d43d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.362777 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.363061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.363331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.363918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 158/326] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.371766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.389700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:47.390951 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:47.446323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:47.483198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 169/327] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:47.484352 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.489323 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:47.515740 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ceb69-360c-4f10-b7c4-099b8d6e0135 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.560018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.560993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.561465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.561802 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] PATH_INFO: `/v3/groups/d1e4e28bb75347aba9dba94f942a7da4` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.564727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] RBAC: Authorizing `identity:get_group(group_id=d1e4e28bb75347aba9dba94f942a7da4)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.566189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.567989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 159/328] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/groups/d1e4e28bb75347aba9dba94f942a7da4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:47.574185 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.609839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6763db-63bd-4bb9-b540-a1842982c017 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.655510 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.656291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.656572 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.656845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.658093 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] RBAC: Adding query filter params (group.id=d1e4e28bb75347aba9dba94f942a7da4, role.id=9c0837507af34315976055cb8e53ab43, scope.project.id=cf75776afbe34a0683dac879dae6d43d) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:47.658448 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.660166 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.670030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 170/329] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/role_assignments?group.id=d1e4e28bb75347aba9dba94f942a7da4&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=9c0837507af34315976055cb8e53ab43 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.703611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18f3-5d81-4652-8606-9b3babbccd93 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:47.761576 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:47.762208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:47.762490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:47.762764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:47.763534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] RBAC: Adding query filter params (group.id=d1e4e28bb75347aba9dba94f942a7da4, role.id=40565a4609a244fab9756b34ef13211e, scope.project.id=cf75776afbe34a0683dac879dae6d43d) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:47.763847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:47.765348 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:47.772736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 160/330] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/role_assignments?group.id=d1e4e28bb75347aba9dba94f942a7da4&scope.project.id=cf75776afbe34a0683dac879dae6d43d&role.id=40565a4609a244fab9756b34ef13211e => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:47.848674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:47.908061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:47.987221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed86c-70e7-4ee7-9c01-e1ab5b3c6989 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:48.026895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:48.027862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:48.028147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:48.028400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:48.041414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:48.046272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:48.047202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:48.048099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 171/331] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:48.056274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:48.078311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:48.190402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314671d-c714-435e-b790-0503fa5c4b50 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:48.233370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:48.233985 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:48.234260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:48.234528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:48.235213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:48.235628 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:48.237222 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:48.247402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 161/332] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:48.253496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:48.367043 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:48.371935 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68ed7-e03b-4db3-a7db-ddf3a1ea4bf4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:48.408147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:48.408771 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:48.409048 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:48.409316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:48.477434 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:48.479087 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:48.574643 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:48.579229 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 172/333] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:11:48.585114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:48.664993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:48.688786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-9d9e-4b99-9c6a-ac791886d024 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:48.722541 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:48.723174 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:48.723469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:48.723743 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] PATH_INFO: `/v3/projects/a29ef887000b41b1862f63176946c6ee` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:48.724866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] RBAC: Authorizing `identity:get_project(project_id=a29ef887000b41b1862f63176946c6ee)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:48.726342 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:48.728062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 162/334] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 25 00:11:48 2022] GET /identity/v3/projects/a29ef887000b41b1862f63176946c6ee => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:48.734171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:48.833698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797b25-173e-4ab7-8d14-f59ea301f5c3 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:48.867941 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:48.868566 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:48.868842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:48.869750 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] PATH_INFO: `/v3/groups/a050119bf8ad45e08d0f01a9c9a4164b` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:48.871014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] RBAC: Authorizing `identity:get_group(group_id=a050119bf8ad45e08d0f01a9c9a4164b)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:48.872474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f3de-9eb7-4327-a750-d5440c7d18e0 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:48.874016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 173/335] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 25 00:11:48 2022] GET /identity/v3/groups/a050119bf8ad45e08d0f01a9c9a4164b => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:48.879933 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:48.983955 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed4c7-fd4d-405e-a8d5-a915298c8858 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:49.018093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:49.018706 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:49.018983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:49.019250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:49.020029 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] RBAC: Adding query filter params (group.id=a050119bf8ad45e08d0f01a9c9a4164b, role.id=70e01e34b4914943a949ed0ea649288a, scope.project.id=a29ef887000b41b1862f63176946c6ee) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:49.020331 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:49.021766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3658-1e7a-4b60-9d2e-67092304ee20 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:49.027640 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 163/336] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 25 00:11:48 2022] GET /identity/v3/role_assignments?group.id=a050119bf8ad45e08d0f01a9c9a4164b&scope.project.id=a29ef887000b41b1862f63176946c6ee&role.id=70e01e34b4914943a949ed0ea649288a => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:51.955072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f580b8-ec01-422a-871b-997e1b2a33c1 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:51.955678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f580b8-ec01-422a-871b-997e1b2a33c1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:51.955678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f580b8-ec01-422a-871b-997e1b2a33c1 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:51.957115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 174/337] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:51.963847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5154ba-9194-4a68-a196-7038965dccf7 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:51.964927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5154ba-9194-4a68-a196-7038965dccf7 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:51.965429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5154ba-9194-4a68-a196-7038965dccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:51.985387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-4b5154ba-9194-4a68-a196-7038965dccf7 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:51.986929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-4b5154ba-9194-4a68-a196-7038965dccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:51.989384 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:52.064216 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 164/338] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:52.230879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671a437-8a66-488d-9150-39372ef20905 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.231542 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671a437-8a66-488d-9150-39372ef20905 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.232083 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671a437-8a66-488d-9150-39372ef20905 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.234607 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 175/339] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:52.241411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251058-1f0f-4cf2-ac34-a7412b7be04c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.242134 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251058-1f0f-4cf2-ac34-a7412b7be04c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.242863 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251058-1f0f-4cf2-ac34-a7412b7be04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.273156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-cf251058-1f0f-4cf2-ac34-a7412b7be04c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:52.275871 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-cf251058-1f0f-4cf2-ac34-a7412b7be04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:52.361368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 165/340] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:52.426361 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671a437-8a66-488d-9150-39372ef20905 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:52.503026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:52.544101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671a437-8a66-488d-9150-39372ef20905 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:52.582669 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119035a-ae84-464f-ad11-5f3d8756008d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.583397 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119035a-ae84-464f-ad11-5f3d8756008d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.583799 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:52.584171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119035a-ae84-464f-ad11-5f3d8756008d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.584480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.584763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.585039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.586795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 166/341] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:52.593204 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.593817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.594286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.597638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:52.599247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:52.615186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:52.616760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:52.616867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:52.617749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:52.618584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:52.618584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:52.618584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:52.618584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 176/342] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:52.624154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:52.700046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:52.712477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 167/343] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:52.712655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:52.751072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1643e9a-6a1f-456b-99ce-91ef8915aa0c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:52.771138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:52.794700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:52.795332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.795654 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.795928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.796586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:52.796890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:52.798449 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf04b7-3bab-48f3-833d-712c60b7b4df None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:52.818272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 177/344] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:52.818272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931ddc-31b5-42a0-8972-374bd9ca8197 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.818272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931ddc-31b5-42a0-8972-374bd9ca8197 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.818272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931ddc-31b5-42a0-8972-374bd9ca8197 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.818272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 178/345] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:52.820472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf931ddc-31b5-42a0-8972-374bd9ca8197 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:52.835317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4755a78-04e9-4756-b358-6d9c87dd5eb1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:52.879942 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:52.880575 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.880861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.881139 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.893239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:52.894798 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-20cfa92c-61f7-4bdf-9b04-6f04a7e99baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:52.912918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:52.913921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:52.914780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:52.914780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:52.914780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:52.914780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 168/346] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:52.915834 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.916250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.916526 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.937649 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:52.939260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:52.954006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf931ddc-31b5-42a0-8972-374bd9ca8197 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:52.991750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:52.995274 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:52.996105 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:52.996384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:52.996651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:52.997321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:52.998775 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.017013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 169/347] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:53.018162 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.034913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 179/348] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:52 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:53.130841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.187906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:53.199791 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1604308-0e95-40d0-ad1d-4b389d53a31b None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.249915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:53.250673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:53.250958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:53.251453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:53.252145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:53.252452 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:53.254595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.271373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 170/349] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:53.278519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.328676 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae34ce5-c938-4a91-a91e-a8844013101b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.346794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:53.383230 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:53.384218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:53.384497 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:53.385266 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:53.402838 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:53.405031 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:53.428335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:53.438121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:53.439787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:53.439787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:53.439787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:53.439787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 180/350] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:53.439787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.440946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e1cc-8004-4ff9-87dc-0c145be16f51 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.481428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:53.482060 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:53.482345 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:53.482620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:53.483274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:53.484762 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.507318 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 171/351] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:53 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:11:53.508167 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.603344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:53.639943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-37f0-4989-8a98-9106cdfda290 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.674788 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:53.684429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f620-6ebf-4112-8424-c71071f6a8d3 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.713765 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:53.714768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:53.715739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:53.716101 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:53.731398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:53.733699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.752633 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:53.753645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:53.754560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:53.755960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:53.755960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:53.755960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:53.756129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:53.756129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:53.756129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:53.757126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:53.758075 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:53.759750 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 181/352] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:53.760452 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:53.761729 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.789633 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 172/353] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:53.799165 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:53.959673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640986e-3622-49ff-83f0-821c6c604a15 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:53.973753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35f3b1-4f5b-4b8c-a1ac-8b341ce867f5 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:54.022701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:54.024493 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:54.024975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:54.026130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:54.027184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:54.027796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:54.029492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:54.039915 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:54.040591 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:54.043125 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:54.043673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:54.044152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:54.045028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:54.046850 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40244d09-c149-4f8f-9684-0d5d4932bc60 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:54.049421 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 182/354] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:54.063154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:54.099455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 173/355] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:53 2022] POST /identity/v3/users => generated 249 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:54.262258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab246f-192f-424d-a1a5-1052c9d12d8f None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:54.336539 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:54.337495 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:54.338013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:54.338496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:54.339692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:54.342046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06e1d4-7e0f-4bc3-9c07-3589d7f68622 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:54.378102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 183/356] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:11:54 2022] POST /identity/v3/users => generated 248 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:11:55.997511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e812-a468-4f77-8854-8685723e7288 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:55.998823 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e812-a468-4f77-8854-8685723e7288 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:55.999463 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e812-a468-4f77-8854-8685723e7288 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.007202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 174/357] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:56.013469 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e769c4-6acf-4f72-b8d2-d9f2983a3c8e None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:56.014649 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e769c4-6acf-4f72-b8d2-d9f2983a3c8e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:56.015130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e769c4-6acf-4f72-b8d2-d9f2983a3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.043373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-27e769c4-6acf-4f72-b8d2-d9f2983a3c8e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:56.045339 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-27e769c4-6acf-4f72-b8d2-d9f2983a3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:56.112869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:56.144908 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 184/358] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:56.300089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264456e-b03a-4347-b206-3bf47f5ed6b3 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:56.300465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264456e-b03a-4347-b206-3bf47f5ed6b3 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:56.300676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264456e-b03a-4347-b206-3bf47f5ed6b3 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.303518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 175/359] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:56.312125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:56.312614 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:56.313097 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.341170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:56.342562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:56.438186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 185/360] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:56.584899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264456e-b03a-4347-b206-3bf47f5ed6b3 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:56.614034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:56.783331 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264456e-b03a-4347-b206-3bf47f5ed6b3 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:56.786655 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:56.832094 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:56.833328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:56.833610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:56.833893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.848763 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:56.856089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:56.857147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:56.857963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:56.859149 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 176/361] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:56.868821 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:56.924625 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6237c-923c-4840-9609-dbc55e4f1067 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:56.942075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:56.969820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:56.970859 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:56.971450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:56.971943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:56.973646 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:56.986373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:56.992116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:56.993131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:56.994063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:56.997342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 186/362] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:11:57.007462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.020652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8742e6-b75d-4fab-a33c-39944e7b6d13 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.069327 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.069983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.070261 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.070542 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.071283 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] RBAC: Adding query filter params (name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:57.071637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.073671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d67e9-e4ff-4d95-9d7c-789cbce6b433 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.091460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 177/363] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:11:57.091460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab540c6-e1f1-43fe-882e-67b71d332193 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.091460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab540c6-e1f1-43fe-882e-67b71d332193 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.091460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab540c6-e1f1-43fe-882e-67b71d332193 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.091460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 178/364] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:11:57.095095 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.095381 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.095732 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.118810 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:57.120524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:57.178973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1dd67-8130-4619-b62b-c8fd73e69630 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.223408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 179/365] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:11:57.224735 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.242108 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.243077 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.243699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.244272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.246005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:57.246633 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.248430 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd15e-3287-4f6b-83b1-dcf53b08662b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.258624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 187/366] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:57.265199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c507-8b11-4161-800d-f4fe8203793c None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.265842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c507-8b11-4161-800d-f4fe8203793c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.266112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c507-8b11-4161-800d-f4fe8203793c None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.267414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 188/367] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:11:57.269245 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6c507-8b11-4161-800d-f4fe8203793c None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.321953 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:57.331298 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:57.387780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151591-7fb1-46b5-98ea-8db2be953094 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.442218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6c507-8b11-4161-800d-f4fe8203793c None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.446899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.447745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.448026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.448300 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.462423 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.465121 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-3d431a19-57d8-450a-a2c2-40275bdb2a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:57.482298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:57.483404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:57.485038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:57.485038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:57.485038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:57.485038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 180/368] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:57.485289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.485685 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.486135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.498232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.498957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.499261 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.499622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.506977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:11:57.508306 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:11:57.514153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.515863 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:57.535326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:57.536622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:57.537522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:57.537522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:57.537522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:57.537522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 189/369] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:57.539939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.607676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 181/370] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:11:57.608793 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.663346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:57.676996 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:57.688437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f890a-2e8f-43fc-b7bf-6cda5ca93965 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.750174 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.751143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.751472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.751796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.752608 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:57.752919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.754710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.770538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 190/371] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:57.771491 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.780054 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3832230-98f1-404d-8fa8-6cebbbae371f None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.843940 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.844970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.845411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.845762 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:57.846692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:57.847242 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:57.850045 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:57.874880 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 182/372] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:57.876421 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:57.946987 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a33a5-a184-4b40-b6c9-dd6d3b3edfd1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:57.991745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:57.992367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:57.992647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:57.992919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.005137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:58.010647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.011707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 191/373] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.012609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.013410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc1c5-18fb-4162-aaaf-56ae07c0d63f None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.022336 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.030712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.058856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.059750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.060255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.060690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.074259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.077153 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:11:58.093291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.094278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 183/374] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 25 00:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.095787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.163053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990ef5-13c2-40d9-b128-98a55127d4f0 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.215631 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.216298 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.216552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.216831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.225170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.226773 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.228179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f185-97c9-4512-8c9c-67322c1eebc0 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:11:58.241691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.242658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:58.243704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 192/375] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.244790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.282103 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.282939 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.283376 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.283790 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.298299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:11:58.304186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.305395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 184/376] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.307771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.332728 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.344055 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.379634 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3236e-8a00-47ad-b493-e7de1be12c09 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.428525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.429485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.430032 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.430446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.431762 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:58.433065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.435254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.446288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee023-5ff7-4a4e-b57a-a9ecae519938 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.446739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 193/377] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:58.447770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.497519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.498038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.498320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.498596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.499344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:58.499704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.501301 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.544974 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 185/378] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:58.545947 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.565546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd29c-f91e-45f5-867e-5bba8406fa92 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.599817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.609461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.610473 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.615897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.615897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.615897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:58.615897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.615897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.675614 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.682258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 194/379] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:58.682258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.695500 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5ba0-af96-4117-8368-549acd8d475d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.748537 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.749474 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.750037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.750621 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.751836 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] RBAC: Adding query filter params (name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:58.752231 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.754292 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.768486 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 186/380] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:58.769786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.811568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fbab2-8630-41e5-bfa4-f317014d1bea None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.857399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.858253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.858715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.859204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.875522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.878119 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.898178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bef9f-a08f-41c0-b4aa-52821751a0ee None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:58.903365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.904406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:58.905521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:58.905521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:58.905521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:58.905521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 195/381] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.906602 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:58.943233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:58.943993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:58.944275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:58.944547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:58.963862 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:58.965339 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.965673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:58.974640 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:58.986091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:58.987087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:58.987946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:58.987946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:58.987946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:58.987946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 187/382] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:58.988479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.044093 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135e3b-8367-4223-afab-ea80cfca4318 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.092312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.093447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.093771 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.094044 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.107279 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.109089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:59.128839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:59.130180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:59.132462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:59.132462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:59.132462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:59.132462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 196/383] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:59.132462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.132758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283123f-8a61-4ae4-901c-c1e28e16a834 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.189815 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.190622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.190903 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.191175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.205969 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.208420 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:11:59.236368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:59.237433 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:11:59.238279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:11:59.238279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:11:59.238279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:59.238279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 188/384] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:59.239160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.267507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.279670 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56622-dec4-44ed-9bb8-0d90d54b2ff2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.308193 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.319890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.320499 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.320782 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.321132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.321805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:59.322095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.324193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.337159 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 197/385] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:59.338754 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.397836 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ab59-fdb0-4f8e-a757-3119ff269471 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.446210 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.446853 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.447676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.448064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.449293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:59.449602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.451021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.465818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 189/386] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:59.466119 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3bae-3b2e-44f0-b991-83a3b25f1737 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.466766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.507194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.508062 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.508424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.508730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.509506 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:59.510497 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.512098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.526343 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 198/387] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:59.526899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.544125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.609827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e8-f2c4-46fb-893e-fc03a2437be8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.629048 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.654558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e117ee-31d6-4433-b4d7-f09d32c9fe47 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.664872 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.665512 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.665786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.666201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.667269 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:11:59.667779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.670153 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.687589 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 190/388] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:11:59.688517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.702407 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.703186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.703630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.704087 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.717536 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.719573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:11:59.737968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:59.739096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:59.740632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 199/389] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:59.741758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.834120 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.834643 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b9e3-9556-402d-b4e9-9fb76d652b00 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.876389 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151cbc-ef22-4e2f-b026-9a4e22176603 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:11:59.885008 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.885757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.886034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.886303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.893780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.895306 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:11:59.911764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:59.912731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:11:59.913566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 191/390] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:59.914024 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:11:59.925401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:11:59.926477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:11:59.926974 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:11:59.927450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:11:59.937954 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:11:59.939482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:11:59.953900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:11:59.954209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:11:59.955085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:11:59.956095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 200/391] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:11:59.956624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.061382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c941-89a5-4dcb-953d-4979225b4ff3 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.072973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340c98a-1923-4d65-83c7-fb8d70dd0289 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.107585 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.111685 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.112697 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.113148 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.113557 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.113898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.114677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.115054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.115334 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.116323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:00.116601 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.118454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.124648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.126289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:00.141027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:00.142597 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 192/392] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:00.143811 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.153029 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 201/393] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Oct 25 00:11:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:00.154064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.276715 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.288378 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfefcd-92d4-4a6c-b00e-cb4e4af8adc8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.296340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26887-4611-42b7-812b-2e34d5ca55e1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.335407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.336059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.336344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.336515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.336660 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.337128 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.337311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:00.337448 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.337621 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.338242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.338868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:00.339168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.339789 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.340641 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.363839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 193/394] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:00.364836 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.370642 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 202/395] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:00.371891 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.437463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.497463 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10091f55-f3d0-413b-8afa-8be34141577d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.499149 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede88-eb4b-4a4c-993c-d70bed29d147 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.539375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.540098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.540409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.540699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.544365 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.545303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.545671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.546062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.547159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:00.547727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.550071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.552384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.553852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:00.573650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:00.574767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:00.575953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:00.575953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:00.575953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:00.575953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 203/396] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:00.575953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.582545 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 194/397] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:00.583967 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.601709 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.712535 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c7598-da35-449d-98ff-d8ecff77042b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.715404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.728831 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf2c6-24eb-43bf-8ee3-21bee7c7fbb0 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.759354 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.761190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.761805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.762297 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/e1a5bdb4170143378833ce36284c2336/roles/0c52a4367912425ea04f302b400ee02f` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.769990 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:00.770663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:00.770964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:00.771211 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/81a90ffe3e5d438d8aa888e20cd40bd8/roles/0c52a4367912425ea04f302b400ee02f` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:00.786326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=e1a5bdb4170143378833ce36284c2336, role_id=0c52a4367912425ea04f302b400ee02f)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.789426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.791612 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=81a90ffe3e5d438d8aa888e20cd40bd8, role_id=0c52a4367912425ea04f302b400ee02f)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:00.793841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:00.808623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 204/398] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:12:00 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/e1a5bdb4170143378833ce36284c2336/roles/0c52a4367912425ea04f302b400ee02f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:12:00.809495 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.819517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 195/399] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:12:00 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/81a90ffe3e5d438d8aa888e20cd40bd8/roles/0c52a4367912425ea04f302b400ee02f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:12:00.819517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:00.899606 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:00.958115 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28f440-82b1-4fe6-bf00-2ce597e6d7a7 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:00.985546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8676-d06e-412e-be65-42fcd6588f14 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.005807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.006582 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.006846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.007131 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.021564 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.023595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.037273 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.038360 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.038823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.039280 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.040187 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:01.040675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.043017 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:01.043561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:01.044695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:01.045927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:01.045927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:01.045927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:01.045927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 196/400] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:01.052742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.063482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 205/401] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:01.074593 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.091971 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:01.226071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48133-b943-417b-8ca7-5cddd10136b2 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.257155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a67-14b8-4c1d-9da4-e8a11fb7ff30 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.294940 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:01.297928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.299347 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.300201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.301200 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.302479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:01.302983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.305430 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.327362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.328534 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.328886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.329312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.331272 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 197/402] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:01.341205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.342973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.346166 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:01.378850 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:01.379772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:01.380812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:01.383223 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 206/403] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:01.390885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.511239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:01.550919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a95ef-6a6e-43fb-ba54-f11f2cb77e65 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.579719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bd7d-5dce-4be5-9565-676c79b67374 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.595693 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.596655 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.597168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.597653 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.598544 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:01.599041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.600735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.620615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 207/404] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:01.621867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.680349 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.681278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.682331 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.682818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.709766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.712224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.756819 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495dace-4256-428c-b414-9fbf9f1aa34f None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:01.759372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:01.760842 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:01.761726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:01.773295 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 198/405] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:01.779351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:01.797593 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:01.808058 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:01.809170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:01.809649 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:01.810192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/ac44864c41224ca58e8a489209f878c9/roles/0c52a4367912425ea04f302b400ee02f` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:01.840785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=ac44864c41224ca58e8a489209f878c9, role_id=0c52a4367912425ea04f302b400ee02f)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:01.842913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:01.867633 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 208/406] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:12:01 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/ac44864c41224ca58e8a489209f878c9/roles/0c52a4367912425ea04f302b400ee02f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:12:01.914311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:02.130689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aba695-2fab-44ca-9b9d-17ea8d060a2c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:02.214657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:02.215782 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:02.216245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:02.216716 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:02.217946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:02.218701 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:02.221615 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fce4a-3dac-44a5-b60d-62c8e97115ad None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:02.253199 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 199/407] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:02.260353 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:02.427314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63de725-b699-49ce-8c55-73d35e98a6eb None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:02.468541 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:02.469218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:02.469498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:02.469769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/dd5e7660d06144ebacc6118fd6192b82/roles/0c52a4367912425ea04f302b400ee02f` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:02.487462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=dd5e7660d06144ebacc6118fd6192b82, role_id=0c52a4367912425ea04f302b400ee02f)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:02.489061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814802b-7677-469f-9e5d-9f9b20ebf397 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:02.504586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 209/408] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:12:02 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/dd5e7660d06144ebacc6118fd6192b82/roles/0c52a4367912425ea04f302b400ee02f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:12:03.541484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f88df-4e3a-46ff-a809-51c6d65afe4f None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:03.542536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f88df-4e3a-46ff-a809-51c6d65afe4f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:03.543068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f88df-4e3a-46ff-a809-51c6d65afe4f None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:03.544861 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 200/409] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:03.550817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:03.551793 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:03.552297 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:03.572750 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:03.574366 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:03.606506 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:03.633764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0eaa9-b061-4faa-9d68-c84d3bee67dd None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:03.634100 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0eaa9-b061-4faa-9d68-c84d3bee67dd None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:03.634506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0eaa9-b061-4faa-9d68-c84d3bee67dd None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:03.636332 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 201/410] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:03.642059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:03.642671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:03.642919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:03.666696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 210/411] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:12:03.668139 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:03.669815 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:03.758477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 202/412] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:04.073444 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.149954 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.180508 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:04.225253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea339968-8110-4a07-bba1-c5f57c306246 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.285616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.287147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.287725 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.288480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.305186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:04.313201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:04.314109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:04.315222 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:04.315986 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ddc1f-4841-4dce-92bb-6be70002e7a5 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.319608 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 211/413] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:04.326145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.380065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:04.388032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.389168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.389837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.390336 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.413510 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:04.424696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:04.426386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:04.428046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:04.436088 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 203/414] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:04.440146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.505623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b425f-f46a-41ab-80a0-e52db99e7c1d None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.560073 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.560936 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.561158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.561437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.562227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:04.562638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:04.564428 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:04.576262 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 212/415] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:04.581798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.589726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:04.623579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092def35-2811-4de8-8541-a2029c1128a6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.682862 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.684123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.684418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.684874 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.686585 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] RBAC: Adding query filter params (name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:04.686897 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:04.689126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:04.706391 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 204/416] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:04.717619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.731855 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:04.747944 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461d54-192e-476e-8d4c-23068b87c919 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.812011 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.813313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.814044 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.814742 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.835573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:04.837432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:04.853521 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab595a8-2c33-4098-8fed-5e98cb88ac38 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:04.857560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:04.858567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:04.859395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:04.859395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:04.859395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:04.861929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 213/417] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:04.868446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:04.909123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:04.909773 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:04.910293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:04.910573 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:04.925784 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:04.927151 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:04.929312 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:04.948257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:04.949919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:04.951400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:04.951400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:04.951400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:04.954391 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 205/418] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:04.955346 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.019185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03078-f14b-48de-9c8a-d379ee1522cc None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.060428 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.061488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.061961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.062445 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.063361 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:05.063889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.065569 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.068591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.086382 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 214/419] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:05.087354 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.090074 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2268-00e9-4009-aeb6-75838e3641fd None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.136508 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.138136 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.138538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.138880 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.139745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:05.140411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.142115 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bacc3e-063c-4696-8d8a-ea02dc32fab2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.160097 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 206/420] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:05.161765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ef09-2fdd-4849-8629-cf2b05697326 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.162087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ef09-2fdd-4849-8629-cf2b05697326 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.162369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ef09-2fdd-4849-8629-cf2b05697326 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.167692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 207/421] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:05.167692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ef09-2fdd-4849-8629-cf2b05697326 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.241185 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a56e3-47af-4907-9476-7c07b376f814 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.241907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.293247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.294155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.294438 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.294706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] PATH_INFO: `/v3/users/glance` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.301882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ef09-2fdd-4849-8629-cf2b05697326 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.304625 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.306099 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-789b6e1d-0d79-4751-9af4-b9dafc0039ef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:05.318209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:05.319328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 215/422] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.321501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.323751 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.343653 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:05.344715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:05.346223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.346898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.347121 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.348651 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.355264 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.356759 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-413bcf0c-058a-46ae-915a-18566cc2a729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:05.371257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:05.372438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:05.373424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:05.377219 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 208/423] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:05.378688 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7b965-e08b-4bc4-8f47-ec9a932c362d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.378977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7b965-e08b-4bc4-8f47-ec9a932c362d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.379250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7b965-e08b-4bc4-8f47-ec9a932c362d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.380764 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 209/424] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:05.381418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7b965-e08b-4bc4-8f47-ec9a932c362d None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.404821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.435485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 216/425] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:05.435485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.498892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7b965-e08b-4bc4-8f47-ec9a932c362d None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.515821 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.542494 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.543119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.543317 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685234-33ef-4236-930d-3e5ceacd08f4 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.543449 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.543691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.544444 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:05.544744 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.547064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535c16-d0f6-4527-a0fd-460817a455cf None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.570069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 210/426] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:05.570069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.570069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.570069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.588611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:05.589820 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:05.596250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.596841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.597074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.597339 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.598072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:05.598904 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.600740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.620811 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 217/427] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:05.621591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.672746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 211/428] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:05.673620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:05.683622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.752544 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3921-cf4a-4e4a-8778-6da6c4bc023a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.793504 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.794833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.795408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.795949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.819909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fdf55-1eeb-410a-a750-e53a5e2a0182 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:05.821621 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.860799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:05.861330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:05.861721 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:05.862059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:05.875226 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.876727 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:05.934231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:05.955039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:05.956560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.011568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 218/429] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:12:06.011568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.069180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 212/430] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:12:06.070052 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.073343 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.128115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbf8f-614f-4d4e-a217-be61f92a09c1 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.172849 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.173487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.173767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.174037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.185215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:06.190094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.192049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 219/431] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.194045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.197867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.201367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8db9d-3f0e-4ef3-86e1-35b0282ad39c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.237346 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.237971 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.238244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.238513 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.248793 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.250251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:06.265402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.266385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:06.267236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:06.267236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.267236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:06.267236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 213/432] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.267236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.302057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e384a8-baa7-4d43-9cd3-394efb801758 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.327569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.338334 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.339357 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.339677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.339950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.350485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:06.355784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.356694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:06.357482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 220/433] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.358121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.380878 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d635dcf-649f-4b60-bd9b-30ebcf932247 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.415545 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.416232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.416515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.416788 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.424815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.427991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.429490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:06.448209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.449209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:06.450038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:06.450038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.450038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:06.450038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 214/434] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.450260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.468710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8f56-a377-4fac-9a38-72d2801a4830 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.504233 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.504842 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.505123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.505386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.506044 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:06.506346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.507866 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.523613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 221/435] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:06.524562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.573430 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09d5d-f67e-4ef1-8a55-c2afb8b01c5a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.580818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.609589 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.610354 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.610452 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.610731 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.611370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:06.611721 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.613119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.626217 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 215/436] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:06.626887 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.630538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f246d3-0ee7-4c86-8f33-f72d47f67751 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.656746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.667454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.668062 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.668338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.668604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.669253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:06.669553 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.670906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.679209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 222/437] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:06.680025 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.747942 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d50bf8-e33c-4b78-9e98-0db287224e67 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.793253 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.793874 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.794156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.794430 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.795083 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:06.795386 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.796796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.802770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229df1-e310-4150-ae71-ce628ff43701 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.810740 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 216/438] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:06.811628 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.845255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.849155 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.850019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.850381 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.850805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.863356 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.864915 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:06.880745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.881748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:06.882673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:06.882673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:06.882673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:06.882673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 223/439] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.882673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:06.928651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:06.932915 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a82051-5656-406a-9119-e16a1de7eaae None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.971692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:06.972349 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:06.972703 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:06.972980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:06.980767 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:06.982263 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:06.995108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:06.996160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:06.996994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:06.997721 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e713d-f547-4150-a3e6-2800871c3b11 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:06.997807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 217/440] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:06.997807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.040145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.040781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.041583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.041862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.055456 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.057146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:07.073358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:07.074459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:07.075485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:07.075485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:07.075485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:07.075873 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 224/441] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:07.080699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.109232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.129852 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d266-a65e-46a5-b733-e326a943442c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.177006 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.177648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.177931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.178205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.186759 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.188323 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:07.202891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:07.203882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:07.204733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:07.207599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 218/442] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:07.208534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.210836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.221238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7e7f-4057-40c8-b4c8-7c4954a3befd None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.258913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.259551 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.260529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.260809 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.261588 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.261897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.263284 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.276130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 225/443] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.277262 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.335278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11cbe8-23f8-4260-8343-ba186dfae824 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.374529 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.375143 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.375459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.375739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.376494 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.376804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.378298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.394221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ec3c-0a20-472d-b1c6-02d928dfc4c4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.398053 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 219/444] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.398994 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.408179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.439218 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.440183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.440183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.440531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.441204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.441471 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.442908 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.454994 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 226/445] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.455866 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.472871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.519505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e787a-6236-4a3e-8717-fc6dd936bb9a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.559070 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.559746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.560028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.560297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.561058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.561297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.562765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.566632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e90cf-c92a-4215-911f-471b5c4f6b6e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.575977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 220/446] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.576745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.610106 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.610731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.611008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.611272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.619169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.621080 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:07.633193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:07.635323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 227/447] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:07.636697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.654484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.696187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ba672-a9e2-408c-a822-49cd5d87b221 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.717498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.740085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.740893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.741171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.741443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.742169 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] RBAC: Adding query filter params (role.id=0c52a4367912425ea04f302b400ee02f, scope.project.id=18e3856a84cc407da62696542e957775, user.id=81a90ffe3e5d438d8aa888e20cd40bd8) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.742474 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.744016 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.750063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 221/448] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/role_assignments?user.id=81a90ffe3e5d438d8aa888e20cd40bd8&scope.project.id=18e3856a84cc407da62696542e957775&role.id=0c52a4367912425ea04f302b400ee02f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.750921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.753114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa2ff-b10d-4eab-a457-10705ffdd04f None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.803980 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.805007 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.805613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.806198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.818825 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.820629 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:07.834826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:07.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:07.837115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:07.844713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 228/449] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:07.845898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:07.902343 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6ab43-d601-4493-a0a1-3dac8f0e6a20 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:07.949765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:07.958567 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:07.959459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:07.960626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:07.961280 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:07.962171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] RBAC: Adding query filter params (role.id=0c52a4367912425ea04f302b400ee02f, scope.project.id=18e3856a84cc407da62696542e957775, user.id=e1a5bdb4170143378833ce36284c2336) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:07.962606 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:07.964830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:07.979727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 222/450] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/role_assignments?user.id=e1a5bdb4170143378833ce36284c2336&scope.project.id=18e3856a84cc407da62696542e957775&role.id=0c52a4367912425ea04f302b400ee02f => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:07.979727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:08.058358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c442-5a31-4e91-9b09-7be090930a3a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:08.112386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:08.120652 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:08.121347 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:08.121626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:08.123958 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:08.124130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:08.124396 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:08.125979 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:08.169911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 229/451] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:08.178701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:08.231491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80769a7-a513-4c0a-867d-0b0f1b2410f0 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:08.274155 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:08.275009 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:08.275558 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:08.275999 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:08.276926 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:08.277390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:08.279214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:08.299286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 223/452] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 25 00:12:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:08.306380 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:08.336800 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f340053-b17e-4988-91bc-9e76482650e8 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:08.371995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:08.387417 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:08.388320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:08.389180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:08.389592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:08.464923 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:08.467985 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531873-8105-4dbc-a6cb-de2f293e6316 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:08.484198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:08.486004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:08.524947 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:08.527524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:08.528680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:08.529275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:08.661218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:08.662818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:08.674782 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 230/453] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 00:12:08.683523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:08.738128 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:08.802995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 224/454] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 00:12:08.816561 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:08.844190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:08.857293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45749-db2e-4b9c-a65c-a85fd65a7497 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:08.920173 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:08.921072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:08.921532 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:08.921980 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:08.941745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:08.943533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:08.971550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:08.972515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:08.973349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:08.973349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:08.973349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:08.976349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 231/455] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:08.982861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.091369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28d19a-1600-4a7c-bd59-b602bcab7bdd None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:09.173127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:09.174614 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:09.175177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:09.175829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:09.193238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:09.195179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:09.208910 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e70f3-1460-47a8-80d2-37ecd8349b89 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:09.228238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:09.229772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:09.230620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:09.230620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:09.230620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:09.232924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 225/456] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:09.240832 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.250594 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:09.284909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:09.285538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:09.285816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:09.286087 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:09.286736 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:09.287035 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:09.288741 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:09.322703 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 232/457] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:09.322703 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.328207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:09.405784 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56559fe2-c246-44a6-a403-283b2459f30a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:09.456721 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:09.457732 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:09.458230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:09.458716 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:09.459670 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:09.460186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:09.462279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:09.480286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 226/458] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:09.488062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.570932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2f2e7-2ef6-44d7-9a84-ad682fc8892d None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:09.658126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:09.661002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:09.663377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:09.666153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:09.666667 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:09.679316 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:09.682244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:09.697498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:09.698424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:09.699341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:09.707900 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 233/459] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:09.711790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.738629 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56941-373c-4ad1-b25e-ff34a51c57f5 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:09.791908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:09.794004 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:09.794513 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:09.795001 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:09.804131 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:09.806679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:09.823737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:09.824630 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:09.825467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:09.827992 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 227/460] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:09.836275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:09.861398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:09.964158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5361b6-93d0-4c6b-b53f-57c2a61c64e6 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:10.078027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:10.080094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.080859 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.081604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.083496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:10.084317 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:10.087700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:10.132610 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 234/461] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:10.144422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:10.161886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527481de-ff5a-43d9-9950-a61e1d9d1103 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:10.251707 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:10.286748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:10.287942 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.288517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.289407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.290424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:10.291146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:10.298169 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:10.341722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 228/462] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:10.343635 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:10.433244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9120f3-e709-43f8-b1b7-51895f5a7b61 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:10.477302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:10.504502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:10.506999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.507784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.509047 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.511442 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] RBAC: Adding query filter params (role.id=0c52a4367912425ea04f302b400ee02f, scope.project.id=18e3856a84cc407da62696542e957775, user.id=ac44864c41224ca58e8a489209f878c9) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:10.512042 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:10.515029 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44b7cf-3e07-4390-9e41-b1cf5b1a1480 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:10.528887 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 235/463] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:12:10 2022] GET /identity/v3/role_assignments?user.id=ac44864c41224ca58e8a489209f878c9&scope.project.id=18e3856a84cc407da62696542e957775&role.id=0c52a4367912425ea04f302b400ee02f => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:10.578419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe6a62-2014-4bbf-93dc-01d359d076b3 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.578716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe6a62-2014-4bbf-93dc-01d359d076b3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.579164 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe6a62-2014-4bbf-93dc-01d359d076b3 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.580861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 236/464] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:12:10.593308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193a28-994e-48a8-a2af-43cf01cf3137 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.593897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193a28-994e-48a8-a2af-43cf01cf3137 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.594112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193a28-994e-48a8-a2af-43cf01cf3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.627004 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-64193a28-994e-48a8-a2af-43cf01cf3137 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:10.628411 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-64193a28-994e-48a8-a2af-43cf01cf3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:10.628716 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb08ce-a766-4f16-8177-aded77a77856 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:10.699616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:10.700632 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.702839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.704837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.707235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] RBAC: Adding query filter params (role.id=0c52a4367912425ea04f302b400ee02f, scope.project.id=18e3856a84cc407da62696542e957775, user.id=dd5e7660d06144ebacc6118fd6192b82) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:10.709058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:10.710892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79583ee-20eb-48cc-920b-c93fc843cf07 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:10.727652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 229/465] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:12:10 2022] GET /identity/v3/role_assignments?user.id=dd5e7660d06144ebacc6118fd6192b82&scope.project.id=18e3856a84cc407da62696542e957775&role.id=0c52a4367912425ea04f302b400ee02f => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:10.743743 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 237/466] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:12:10.762670 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad192d4-571e-42d9-8610-b5a3b4df7bda None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.765244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad192d4-571e-42d9-8610-b5a3b4df7bda None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.767755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad192d4-571e-42d9-8610-b5a3b4df7bda None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.770815 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 230/467] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:10.777624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:10.777934 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:10.778174 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:10.808249 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:10.809517 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:10.908776 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 238/468] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:11.096563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad192d4-571e-42d9-8610-b5a3b4df7bda None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.163329 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:11.222086 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad192d4-571e-42d9-8610-b5a3b4df7bda None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:11.261443 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.264757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:11.270035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:11.270035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:11.270035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] PATH_INFO: `/v3/services/image` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:11.270035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:11.270035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:11.284846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:11.285935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:11.286738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 231/469] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:11.296942 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.387761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:11.452935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b49-7845-42db-81bc-d731a8bd4ec4 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:11.483794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:11.511747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6962-09c0-412e-9ac6-9dc4c7f18751 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:11.515579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:11.516205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:11.516487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:11.516761 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:11.517402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] RBAC: Adding query filter params (name=image) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:11.517715 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:11.519339 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:11.531707 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 232/470] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:11.540456 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.572735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:11.573934 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:11.574672 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:11.575333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:11.591537 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:11.597464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:11.598400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:12:11.599191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:11.603768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 239/471] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:11.617904 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.745135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ff7c-0e08-4e72-b978-8a6e71233d6e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:11.823551 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:11.827535 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:11.827535 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:11.827825 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:11.828420 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] RBAC: Adding query filter params (type=image) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:11.828728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:11.830150 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:11.840683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 233/472] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:11.851464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397809-47de-40b6-a728-191cc55c79a0 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:11.863200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:11.902638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:11.903731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:11.904315 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:11.904889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:11.906014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:11.906592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:11.908621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:11.920764 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 240/473] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:11.929581 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:11.986920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:12.077333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36703af3-66ec-47c7-95a3-585a2bcb3024 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:12.123286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:12.124360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:12.124862 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:12.125340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:12.139406 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:12.141286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:12.160997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:12.161965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:12.162801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:12.162801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:12.162801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:12.165525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 234/474] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:12.172605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:12.303235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01d224-e3bb-42b9-b497-f5cfe76aedc7 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:12.348033 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:12.348662 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:12.348983 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:12.349260 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:12.349907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:12.350214 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:12.355458 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:12.365726 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 241/475] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:12.377556 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:12.488056 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:12.498661 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3af9-9a39-4384-9bf1-e51cab3cde85 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:12.538402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da629-b979-466c-8d85-745f562285f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:12.539405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da629-b979-466c-8d85-745f562285f1 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:12.539927 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da629-b979-466c-8d85-745f562285f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:12.540416 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da629-b979-466c-8d85-745f562285f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:12.549249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da629-b979-466c-8d85-745f562285f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:12.551047 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da629-b979-466c-8d85-745f562285f1 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-304da629-b979-466c-8d85-745f562285f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:12.563829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:12.564779 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:12.565684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 235/476] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 25 00:12:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:12.577902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:12.620939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:12.737234 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610d62-0ea3-46a8-ac27-87b81077ded4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:12.818671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:12.819297 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:12.825341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:12.825341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:12.825341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:12.825341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:12.825341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:12.844376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 242/477] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 25 00:12:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:12.857799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da629-b979-466c-8d85-745f562285f1 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:12.983674 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da629-b979-466c-8d85-745f562285f1 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:13.021151 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:13.022146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.022627 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.023117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.035664 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:13.037568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:13.053671 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:13.054599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:13.055469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:13.055469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:13.055469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:13.057681 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 236/478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:13.063372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:13.167991 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:13.186901 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cb55-49f6-4b13-b5db-2ce9e2473ea2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:13.224530 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:13.225441 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.225884 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.226415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.227286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:13.228747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:13.230639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d8bd-f618-4dc8-ac3e-4a82d78bba43 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:13.247769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 243/479] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:13.250855 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:13.254992 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:13.373472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3288db-d136-4878-887e-4824a8e05791 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.373587 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3288db-d136-4878-887e-4824a8e05791 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.373831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3288db-d136-4878-887e-4824a8e05791 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.375280 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 244/480] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:12:13.382089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae2ce5-ff61-4850-8f23-490645325e33 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.382368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae2ce5-ff61-4850-8f23-490645325e33 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.382631 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae2ce5-ff61-4850-8f23-490645325e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.402144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1aab-f2a8-454b-9072-4170b0927464 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:13.413251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-6cae2ce5-ff61-4850-8f23-490645325e33 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:13.414555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-6cae2ce5-ff61-4850-8f23-490645325e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:13.448058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:13.451294 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.451881 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.452360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.464314 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:13.468342 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:13.483812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:13.484829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:13.485691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:13.488195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 237/481] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:13.496632 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:13.555706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 245/482] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:13.606024 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:13.614094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4fbc-e5d9-4adb-b9bc-734e4abbf1ad None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.614408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4fbc-e5d9-4adb-b9bc-734e4abbf1ad None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.614803 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4fbc-e5d9-4adb-b9bc-734e4abbf1ad None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.616568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 246/483] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:12:13.623489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea4f3-2746-4062-b886-128b87575696 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.623489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea4f3-2746-4062-b886-128b87575696 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.623489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea4f3-2746-4062-b886-128b87575696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.653710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-979ea4f3-2746-4062-b886-128b87575696 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:13.654902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-979ea4f3-2746-4062-b886-128b87575696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:13.655812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4c50-6ee4-4814-92e5-1a8601e8cb2f None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:13.699998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:13.700611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.700889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.701997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.701997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:13.703199 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:13.703898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:13.725300 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 238/484] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:13.726355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:13.816266 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 247/485] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:13.847800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455becd-7cf6-42aa-9dca-98426fe0fc8f None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:13.876547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:13.890092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:13.890763 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:13.891037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:13.891307 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/e1a5bdb4170143378833ce36284c2336/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:13.893416 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=e1a5bdb4170143378833ce36284c2336, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:13.894948 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:13.915646 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 239/486] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:12:13 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/e1a5bdb4170143378833ce36284c2336/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:12:13.944480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ea4f3-2746-4062-b886-128b87575696 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:13.964337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:14.133465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ea4f3-2746-4062-b886-128b87575696 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:14.181452 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:14.182835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.187455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.187455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] PATH_INFO: `/v3/services/network` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.187455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:14.187455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:14.198134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:14.199332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.200293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 248/487] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:13 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:14.207473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:14.221840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:14.317982 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:14.337943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ce9e-7482-45db-b234-0b74818defa9 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:14.386487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf342ca-f5de-44a1-8da3-6ae176f9cf9d None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:14.401328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:14.402249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.403180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.403631 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.404447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] RBAC: Adding query filter params (name=network) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:14.405077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:14.406894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:14.422232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 240/488] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:14.429598 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:14.446694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:14.448385 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.451788 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.452328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.453146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:14.454787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:14.473837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:14.474869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:14.475712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:14.488140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 249/489] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 25 00:12:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:14.493672 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:14.561417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:14.691706 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bb2fc-571c-4ef8-b42b-58cc22738d2d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:14.720115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194d08-aa7c-4ae7-b997-003af6625c9b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:14.776712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:14.777717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.778204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.778703 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.779989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:14.780540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:14.782186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:14.782821 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:14.783491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.784937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.786318 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.787037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] RBAC: Adding query filter params (type=network) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:14.787339 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:14.787841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:14.790660 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 250/490] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:14.792602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dabe2-ddf3-4e05-a04a-68a1c5b07dbd None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:14.796362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:14.812819 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 241/491] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:14.824449 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fc46-8758-48a8-8d16-f3aaf382226d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.824800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fc46-8758-48a8-8d16-f3aaf382226d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.825000 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fc46-8758-48a8-8d16-f3aaf382226d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.831321 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 242/492] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:14.832850 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:14.833127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:14.833479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:14.854322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:14.855714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:14.959988 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 243/493] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:14.974094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9ee2-dcf4-46ae-9197-dfc87683024b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:15.023200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31084c27-a73a-475a-a661-901ae294971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:15.024344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31084c27-a73a-475a-a661-901ae294971e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:15.024774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31084c27-a73a-475a-a661-901ae294971e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:15.025268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31084c27-a73a-475a-a661-901ae294971e None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:15.027143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31084c27-a73a-475a-a661-901ae294971e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:15.030529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31084c27-a73a-475a-a661-901ae294971e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:15.032207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31084c27-a73a-475a-a661-901ae294971e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:15.042531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 251/494] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:15.381753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:15.440455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:15.514228 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f41ce-29c5-4c60-87b2-89ffb7dfd244 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:15.591028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:15.591714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:15.591991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:15.592258 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:15.592917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:15.594625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce7da4-f2be-43da-b538-89e1e8a2ef29 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:15.623599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 244/495] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:15 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:16.886812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8857d5-d194-4288-939e-bc105fd23a02 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:16.886812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8857d5-d194-4288-939e-bc105fd23a02 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:16.886812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8857d5-d194-4288-939e-bc105fd23a02 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:16.886812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 252/496] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:16.892172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:16.892602 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:16.892702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:16.913395 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:16.914600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:17.007692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 245/497] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:17.431416 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8857d5-d194-4288-939e-bc105fd23a02 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:17.524200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:17.574636 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8857d5-d194-4288-939e-bc105fd23a02 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:17.613234 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:17.614117 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:17.614562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:17.614970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:17.627509 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:12:17.632848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:17.633746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:12:17.634527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:17.638712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 253/498] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:17.644774 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:17.695196 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:17.801807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b882-33c7-4594-a839-70ede74fadee None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:17.845289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:17.846205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:17.846688 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:17.847140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:17.848032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:17.848529 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:17.850115 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875ca8f-00de-4155-90ba-ac3d556e9244 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:17.861808 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 246/499] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:17.866154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:17.913095 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6d721-8ae9-4838-b001-d3986ac1de38 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:17.914296 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6d721-8ae9-4838-b001-d3986ac1de38 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:17.914784 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6d721-8ae9-4838-b001-d3986ac1de38 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:17.922195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 247/500] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:17.924047 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956dca-dc4c-4b96-ab84-27decb8f3f8a None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:17.924544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956dca-dc4c-4b96-ab84-27decb8f3f8a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:17.925016 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956dca-dc4c-4b96-ab84-27decb8f3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:17.945939 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-04956dca-dc4c-4b96-ab84-27decb8f3f8a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:17.948029 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-04956dca-dc4c-4b96-ab84-27decb8f3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:18.047466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 248/501] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:17 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:18.047466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658eec-4acb-4660-9a40-a3f286962a20 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.047466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658eec-4acb-4660-9a40-a3f286962a20 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.047466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658eec-4acb-4660-9a40-a3f286962a20 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.052521 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 249/502] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:18.057614 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.057901 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.058579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.079309 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb45a-5417-48d5-b032-7ca0e16d1f1e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:18.080987 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:18.083206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:18.104375 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:18.117671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:18.149957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:18.151761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.153336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.153792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.186029 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:18.187490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:18.212806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:18.214390 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:18.215450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:18.215450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:18.215450 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:18.218926 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 254/503] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:18.224913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:18.266326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 250/504] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:18 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 00:12:18.421912 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:18.424830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d09d2-430f-4da5-bb88-adf65b7f7f7e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:18.470336 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:18.470963 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.471244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.475447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.475447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:18.475447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:18.475447 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:18.500993 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 255/505] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:18.511925 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:18.588503 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:18.656777 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ed45-7304-431c-b772-6cfb9f2cd6af None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:18.685158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aef4e2-f857-4550-8b9e-3ecfde97317c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:18.697627 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:18.698333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.698613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.698956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.699691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:18.701079 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002995f1-950c-4568-9eb8-c5ebf7f17ad7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:18.727729 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 251/506] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:18 2022] POST /identity/v3/services => generated 240 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:18.730014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a43f-8ae8-496a-9ddf-6abad262984c None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.730302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a43f-8ae8-496a-9ddf-6abad262984c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.730578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a43f-8ae8-496a-9ddf-6abad262984c None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.732448 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 252/507] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:18.733265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a43f-8ae8-496a-9ddf-6abad262984c None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:18.745398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:18.746631 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.747126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.748013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] PATH_INFO: `/v3/users/nova` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.749161 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:18.761798 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:18.763675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-2f9ba655-a9a1-41db-901e-15bd86fe410f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:18.781195 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:18.782192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 00:12:18.783114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:18.786039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 256/508] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 25 00:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:18.787892 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.788509 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.788995 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.810859 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:18.812535 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:18.867704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a43f-8ae8-496a-9ddf-6abad262984c None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:18.921227 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 257/509] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:18 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 00:12:18.924632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:18.932469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:18.933975 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:18.934474 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:18.935026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:18.936067 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:18.937890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:18.952946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:18.962048 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 253/510] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:18 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:19.101356 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37eb7-7fa0-47cd-afbd-d906a57f341e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:19.172377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:19.173387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:19.173890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:19.174363 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:19.175345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:19.175889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:19.177654 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:19.203634 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 258/511] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 25 00:12:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:19.213585 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:19.312928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:19.340937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:19.361120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cba6-12c4-4c6f-b24a-820644992784 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:19.449286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:19.451144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:19.451144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:19.451144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:19.541743 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:19.608776 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:19.611038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:19.622128 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921a88-234f-4bc6-9960-b72862da67d8 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:19.703463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:19.704384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:19.704906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:19.705340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] PATH_INFO: `/v3/services/image` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:19.706107 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:19.709007 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:19.732161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:19.733489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:19.734507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:19.736565 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 259/512] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 25 00:12:19 2022] GET /identity/v3/services/image => generated 86 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:19.744142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:19.789364 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:19.870827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 254/513] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:12:19 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 00:12:19.877266 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:19.949710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4126f4-99d4-4ccf-9322-54f738580693 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.033002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.033885 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.034256 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.034620 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.035372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] RBAC: Adding query filter params (name=image) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:20.035794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.037543 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.055888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 260/514] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:20.061929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.071978 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:20.091520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866c92b-5900-4c5b-b782-21f466dcf82e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.175783 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.178206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.179518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.180774 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.209348 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcedaa-e8d7-4def-9303-c25570977e3e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.210852 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.214415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:20.261005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:20.262198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:20.263359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:20.263359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:20.263359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:20.264817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 255/515] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:20.272042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.272310 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.273129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.273504 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.273868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.274595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] RBAC: Adding query filter params (type=image) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:20.274988 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.277678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.292080 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 261/516] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:20.293181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.329477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:20.412525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:20.478089 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a7ff7-2f96-461f-8ee9-ec585c14f819 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.530336 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c960-8460-45a9-827f-0e65b0ab22f5 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.557586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.559623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.561114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.561624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.564030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] RBAC: Adding query filter params (interface=public, service_id=80bb2b2e0af94dd8899f84cb13fcaf72, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:20.564573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.566197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.583372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 262/517] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/endpoints?service_id=80bb2b2e0af94dd8899f84cb13fcaf72&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:20.592690 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.594539 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.595159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.595483 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.595823 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.596695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:20.597003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.599713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.626377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 256/518] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:20.629348 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.739483 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:20.761827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc864a-85f1-4d1c-9e90-eb80342eb292 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.808640 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.811097 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.811662 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.812164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.820279 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.822062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.828115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800951bb-2bbb-4a61-937f-7e0483900607 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:20.836532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:20.837424 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:20.838839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:20.847554 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:12:20.851758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:20.903415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:20.920776 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:20.922500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:20.922500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:20.922500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:20.923501 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:20.925113 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:20.949835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/services => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:21.115562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aaf78-a93e-4588-845c-d0dbb49cfe55 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:21.252188 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:21.255447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.255447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.255447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.255447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:21.255447 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:21.255802 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055062-fa25-43b8-9bd7-2bf0ae9733ba None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:21.271728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:21.279644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:21.428526 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933367-9ec0-481d-a8a9-d7176168ddcf None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:21.628232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:21.628866 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.629152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.629433 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.630263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] RBAC: Adding query filter params (role.id=70e01e34b4914943a949ed0ea649288a, scope.project.id=18e3856a84cc407da62696542e957775, user.id=e1a5bdb4170143378833ce36284c2336) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:21.630487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:21.632002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc06d6a-f5d6-40ff-a526-c51d0581f65d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:21.665913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:12:21 2022] GET /identity/v3/role_assignments?user.id=e1a5bdb4170143378833ce36284c2336&scope.project.id=18e3856a84cc407da62696542e957775&role.id=70e01e34b4914943a949ed0ea649288a => generated 608 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:21.747277 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34bbaf-cca8-424e-a56c-25e17ea2a34f None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.747705 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34bbaf-cca8-424e-a56c-25e17ea2a34f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.747886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34bbaf-cca8-424e-a56c-25e17ea2a34f None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.749425 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 259/523] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:21.757037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.757301 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.757591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.799806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:21.801812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:21.844995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0871-b8e1-463c-bd01-3610c15cdb04 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.845405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0871-b8e1-463c-bd01-3610c15cdb04 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.845687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0871-b8e1-463c-bd01-3610c15cdb04 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.847388 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 260/524] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:21.854746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:21.855094 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:21.855326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:21.886856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:21.933111 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:21.937173 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:21.971367 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:22.020075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 265/525] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:22.119613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 261/526] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:22.346867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.465975 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.470960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2fd64-3bfc-4bb4-8137-6f9a33e89210 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:22.508920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:22.510621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:22.511200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:22.511717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:22.512514 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:22.514186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:22.523856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:22.524920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:22.526311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:22.533879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:22.535151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.577180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232b85-0ec2-4d5f-91bb-e00a15acb306 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:22.594990 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:22.616329 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:22.620110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:22.621047 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:22.621471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:22.621883 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] PATH_INFO: `/v3/services/network` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:22.622610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:22.624168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:22.635299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:22.636531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:22.637351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:22.640327 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 262/528] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:22.647807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.673240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2067-602d-4568-af9d-8950dafd0df0 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:22.730324 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:22.731126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:22.732010 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:22.732404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:22.733378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:22.733709 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:22.735668 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:22.748538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 267/529] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:22.749714 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.796118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8f008-d6c1-4660-8cbd-31c89a69fff1 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:22.834021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:22.834631 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:22.834957 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:22.835222 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:22.836049 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] RBAC: Adding query filter params (name=network) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:22.836569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:22.838989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:22.844990 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 263/530] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:22.851576 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.888211 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af6c1-16b2-4dad-8b45-5cee8c28ea50 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:22.916083 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:22.924383 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:22.941980 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:22.942867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:22.943325 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:22.943775 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:22.944578 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:22.945027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:22.946573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:22.958179 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 268/531] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:22.959464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:22.979480 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06116c6-737b-4cdf-97af-45a920afde8e None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:23.020012 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:23.020773 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.021144 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.021512 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.022243 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] RBAC: Adding query filter params (type=network) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:23.022680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:23.024547 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:23.031477 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 264/532] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:23.037989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:23.096892 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9dcd-810a-43b9-842b-a4c93d3177c6 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:23.148203 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:23.148567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.148852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.149125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.149830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] RBAC: Adding query filter params (interface=public, service_id=f5093568d4764e418cdf324efb204be2, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:23.151048 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:23.152724 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:23.170468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 269/533] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:22 2022] GET /identity/v3/endpoints?service_id=f5093568d4764e418cdf324efb204be2&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:23.171818 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:23.192525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20f1e-d38d-45f7-a43b-fd0f34effc2a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:23.234603 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:23.247656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:23.262367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:23.263010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.263286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.263604 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] PATH_INFO: `/v3/endpoints` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.264354 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] RBAC: Adding query filter params (interface=public, service_id=c0f0b9789bf64519ad8fc92dd9bf81d7, region_id=RegionOne) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:23.264639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:23.266039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:23.295131 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 265/534] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:23 2022] GET /identity/v3/endpoints?service_id=c0f0b9789bf64519ad8fc92dd9bf81d7&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:23.296181 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:23.370082 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382885f-2223-45b3-8620-163aab1af917 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:23.436895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:23.438976 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.441121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.441652 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.442778 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:23.445059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c305c-6a35-45a4-aab3-1db0aec4f953 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:23.458592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 270/535] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:23 2022] GET /identity/v3/services => generated 1002 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:23.507986 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e55b8-fbd6-44c8-9336-c17d91425efb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:23.553369 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:23.554450 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.555024 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.555538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.556405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:23.558265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b8464-0cb9-4f4e-9b36-b850ecd9e68e None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:23.565488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 266/536] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:23 2022] GET /identity/v3/services => generated 1002 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:23.818311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150729a-b29a-4f16-b03a-f0301c766da2 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.818594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150729a-b29a-4f16-b03a-f0301c766da2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.818867 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150729a-b29a-4f16-b03a-f0301c766da2 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.820710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 271/537] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:23.827259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf061a4-69b6-42bd-b44d-0e469ba093ce None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:23.827638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf061a4-69b6-42bd-b44d-0e469ba093ce None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:23.827945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf061a4-69b6-42bd-b44d-0e469ba093ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:23.848969 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-2cf061a4-69b6-42bd-b44d-0e469ba093ce None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:23.850175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-2cf061a4-69b6-42bd-b44d-0e469ba093ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:23.909798 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:23.932188 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 267/538] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:24.274883 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150729a-b29a-4f16-b03a-f0301c766da2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:24.320771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379005-e9fb-45dd-a0e3-3d01efa6daa1 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:24.322667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379005-e9fb-45dd-a0e3-3d01efa6daa1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:24.323418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379005-e9fb-45dd-a0e3-3d01efa6daa1 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:24.326177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 268/539] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:24.335471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:24.335471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:24.335471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:24.353946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:24.355159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:24.407126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150729a-b29a-4f16-b03a-f0301c766da2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:24.420796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:24.463716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:24.463716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:24.463716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:24.463716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] PATH_INFO: `/v3/services/image` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:24.464379 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 269/540] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:24.464482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:24.466821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:24.485939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:24.486968 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 00:12:24.487829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:24.488589 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 272/541] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 25 00:12:24 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:24.494896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:24.632685 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362458-c595-4790-8133-95ea5f88c4d1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:24.659254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:24.699487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:24.701009 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:24.701851 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:24.702698 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:24.704126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] RBAC: Adding query filter params (name=image) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:24.705016 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:24.708074 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:24.723496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 270/542] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:24.729301 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:24.798021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:24.865419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fae8-2cc0-4418-a9af-c33c1daa8e10 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:24.918693 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:24.919794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:24.920300 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:24.920777 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:24.921664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] RBAC: Adding query filter params (type=image) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:24.922293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:24.924027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:24.935533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 273/543] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:24.937256 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:24.978232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:24.988920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897943d-bfb6-4df1-9a59-a0d96605b745 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:25.038229 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:25.039399 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:25.039991 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:25.040497 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:25.041439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:25.044037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:25.053873 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313f26-090f-41ad-ba36-c8394c8bf760 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:25.055848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:25.056886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:25.058096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:25.067748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 271/544] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 25 00:12:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:25.070029 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:25.094505 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:25.095383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:25.095594 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:25.095863 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:25.096538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:25.097967 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:25.131768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 274/545] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:12:25.148040 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:25.260886 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3879e57-05cf-4f35-a912-cc0dc11da402 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:25.334201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:25.335414 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:25.335907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:25.336344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:25.337443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:25.338492 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:25.340982 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28846bd-cea6-4f09-b3b2-3cc812bb636b None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:25.350236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 272/546] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:25.358687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:25.488785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:25.503245 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8326b21-2ff3-4af5-b4d2-20b7c59faeb5 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:25.542363 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:25.543082 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:25.543365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:25.543663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:25.544362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:25.544749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:25.546140 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a774-27a8-45a1-874e-118749b2297e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:25.552333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 275/547] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:26.166437 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc917-7403-450e-a268-0770e294e115 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.166826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc917-7403-450e-a268-0770e294e115 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.167005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc917-7403-450e-a268-0770e294e115 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.168645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 273/548] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:26.174056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ea05-a36f-4ac0-b013-a00bd6901059 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.174346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ea05-a36f-4ac0-b013-a00bd6901059 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.174624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ea05-a36f-4ac0-b013-a00bd6901059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.193935 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2882ea05-a36f-4ac0-b013-a00bd6901059 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:26.194704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2882ea05-a36f-4ac0-b013-a00bd6901059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:26.269127 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 276/549] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:26 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:26.594901 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafc917-7403-450e-a268-0770e294e115 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:26.655231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026896-fc56-416a-b715-e287d4b54df3 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.655770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026896-fc56-416a-b715-e287d4b54df3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.655871 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026896-fc56-416a-b715-e287d4b54df3 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.657404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 277/550] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:12:26.662478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.662763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.663039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.681997 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:26.683373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:26.705027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:26.709154 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafc917-7403-450e-a268-0770e294e115 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:26.750528 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:26.751176 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.751560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.751896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.752488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:26.753914 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:26.762372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 278/551] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:26 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:26.769164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:26.770239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 00:12:26.771071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:26.773797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 274/552] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 25 00:12:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:26.780021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:26.803395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:26.896269 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607d767-0a3f-4ee9-be74-2b5dbe47864e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:26.935162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:26.936190 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:26.936689 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:26.937163 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:26.938030 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:26.938549 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:26.940146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:26.945974 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 279/553] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:26.951857 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.059536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4850-2c5b-40dd-930c-cdb9a7e6e291 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.097406 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.098039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.098326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.098607 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.099259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:27.099601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.101004 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.107165 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 275/554] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 25 00:12:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:27.108472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.116168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.157600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:27.216500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:27.238057 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629dae-346c-407c-af07-379f17e55a19 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.239989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1d31-6489-4bc7-b907-9f785ef274b5 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.276555 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.277729 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.278197 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.278663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.278818 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.279593 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.279937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.280043 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.280285 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] PATH_INFO: `/v3/services/network` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.280937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.281993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.282547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:27.293318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:27.294399 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 00:12:27.295257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:27.299730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 280/555] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:27 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:27.300623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.312102 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 276/556] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:27.448758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9699-739d-4c58-b1ee-0f3d57e3a90a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.499028 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.499691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.499971 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.500243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.500886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] RBAC: Adding query filter params (name=network) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:27.501191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.502636 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.508667 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 281/557] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:27.515372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.615846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:27.633976 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f640a27-39c6-4a65-90b6-25c0e78833c0 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.670410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.671051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.671334 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.671664 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.672330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] RBAC: Adding query filter params (type=network) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:27.672639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.674186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865bf5-9fc2-4e3b-a2ea-82d346a5784d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.680484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 277/558] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:27.686657 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:27.691852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:27.799525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935743-3b47-47df-b5b1-8062c586dff7 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:27.836748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:27.837636 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.838709 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.839210 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.840095 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:27.841610 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdaca9-5faf-4c6f-bb83-ed724fd4ec0f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:27.859045 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4394c5-5ace-4b06-a131-6c08c2f5e939 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.859290 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4394c5-5ace-4b06-a131-6c08c2f5e939 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.859445 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4394c5-5ace-4b06-a131-6c08c2f5e939 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.861054 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 278/559] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:12:27.865192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 282/560] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:27.868973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f7c1-be70-4c36-b9e1-679b8064349e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:27.868973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f7c1-be70-4c36-b9e1-679b8064349e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:27.868973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f7c1-be70-4c36-b9e1-679b8064349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:27.888239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7615f7c1-be70-4c36-b9e1-679b8064349e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:27.889482 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7615f7c1-be70-4c36-b9e1-679b8064349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:27.980136 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 279/561] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:27 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 00:12:28.142226 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d278e-e4ed-4cf2-829f-96d10e38740e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.142568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d278e-e4ed-4cf2-829f-96d10e38740e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.142746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d278e-e4ed-4cf2-829f-96d10e38740e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.144070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 283/562] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:28.149650 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.150013 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.150827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.172122 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:28.173462 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:28.253130 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 280/563] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:28 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:28.313874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d278e-e4ed-4cf2-829f-96d10e38740e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:28.386426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:28.440819 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d278e-e4ed-4cf2-829f-96d10e38740e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:28.475335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:28.475965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.476246 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.476519 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.477181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:28.479275 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:28.486848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.sql.core [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:28.486848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:12:28.486848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [parameters: {'id': 'c1aebf4ceb6b4792b92695e912d1a7cb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 00:12:28.486848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:28.494329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 00:12:28.495133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application yield resource Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise self.value Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application session.commit() Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 00:12:28.496691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.flush() Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application compat.raise_( Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 00:12:28.497583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 00:12:28.498779 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:28.499626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [parameters: {'id': 'c1aebf4ceb6b4792b92695e912d1a7cb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 00:12:28.501651 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:28.503558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:28.505785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 284/564] 10.222.0.18 () {60 vars in 1137 bytes} [Tue Oct 25 00:12:28 2022] POST /identity/v3/domains => generated 190 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:28.507667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:28.508314 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:28.581028 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:28.618241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00242d-d3da-4be6-b20d-fecde4a38928 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:28.658605 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:28.659230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.659544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.659818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.670683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:28.672189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:12:28.689157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:28.690390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:12:28.691727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:12:28.691727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:12:28.691727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:28.695388 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 281/565] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:28.696236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:28.702275 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036a93-bd80-45b7-a148-251ff24c5c70 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:28.729971 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:28.743566 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:28.744419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.744847 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.745158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.745928 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:28.747370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ead4e-32b5-4044-8bd1-0f9e2c2c3826 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:28.759244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:28.765918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 285/566] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:28 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:12:28.814070 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b327df-6e23-4853-9dba-a40677f40616 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:28.861846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:28.862469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:28.862750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:28.863022 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:28.863711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:28.864016 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:28.865439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d1822-58c1-43a9-a0f8-16ee90d61bff None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:28.887719 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 282/567] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:29.886909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b28a9-904e-4a84-ac8a-56858483f760 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:29.887487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b28a9-904e-4a84-ac8a-56858483f760 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:29.887487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b28a9-904e-4a84-ac8a-56858483f760 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:29.888785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 286/568] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:29.894380 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:29.894795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:29.895061 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:29.914295 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:29.915618 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:29.992073 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 283/569] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:29 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:30.311929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b28a9-904e-4a84-ac8a-56858483f760 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:30.429069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b28a9-904e-4a84-ac8a-56858483f760 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:30.465656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:30.466282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:30.466554 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:30.466815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:30.467459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:30.468825 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:30.478239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:30.480550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:30.481370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 287/570] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:30.485382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:30.529281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:30.591487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aec89-f1a4-4f22-b16d-4074d17c62c2 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:30.625827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:30.626460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:30.626730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:30.627005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:30.627931 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:30.628247 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:30.629856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e41c36-ae7f-480b-a479-5943980ed9b2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:30.635553 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 284/571] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:30.641607 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:30.691398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:30.743554 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc7b7a-0cb6-482c-9448-4f119d639138 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:30.776773 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:30.777375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:30.777655 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:30.777929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:30.778557 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:30.778861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:30.780369 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311afd3f-3c4c-4e8c-8057-22f9879225a7 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:30.784897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 288/572] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:31.303099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46bc4-5d13-4ba7-8181-493caed76557 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:31.303663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46bc4-5d13-4ba7-8181-493caed76557 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:31.303866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46bc4-5d13-4ba7-8181-493caed76557 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:31.305877 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 285/573] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:31.311993 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:31.312482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:31.312603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:31.330808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:31.332006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:31.430353 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 289/574] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:31 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:31.764649 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46bc4-5d13-4ba7-8181-493caed76557 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:31.868317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46bc4-5d13-4ba7-8181-493caed76557 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:31.876453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:31.904772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:31.905402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:31.905667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:31.905935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:31.906505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:31.907906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:31.917104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:31.918208 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:31.919109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 286/575] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 25 00:12:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:31.924251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:31.969212 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:32.027742 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f5e49-3186-4ed5-ad39-dad772a8d85f None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:32.061711 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:32.062312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:32.062587 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:32.062856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:32.063520 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:32.063816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:32.065193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:32.069852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 290/576] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:32.076273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:32.177754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ff40-1e20-4514-9b13-ed76c816fdc8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:32.214600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:32.215201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:32.215503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:32.215774 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:32.216393 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:32.216692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:32.218058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:32.223019 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 287/577] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:32.229365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:32.330284 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed860e-e257-4203-8fb1-0e800c92629a None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:32.337006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:32.364235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:32.364840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:32.365116 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:32.365384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:32.366112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] RBAC: Adding query filter params (interface=public, service_id=811d11733a124da6b2cf10a7bc839dbc, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:32.366418 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:32.367831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d2282-c160-45e2-8fc7-e5972334726f None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:32.373840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 291/578] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:32 2022] GET /identity/v3/endpoints?service_id=811d11733a124da6b2cf10a7bc839dbc&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:32.379710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:32.414973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:32.481757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98471-d760-4bae-abc1-629aa74483f6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:32.514175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:32.514798 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:32.515078 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:32.515346 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:32.515967 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:32.517328 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2f7d-c8c9-4e93-bd9d-9ef7c689b995 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:32.522801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 288/579] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:32 2022] GET /identity/v3/services => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:33.249546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c2c3-2eff-4419-b2a9-10c61482a36a None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:33.249831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c2c3-2eff-4419-b2a9-10c61482a36a None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:33.250102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c2c3-2eff-4419-b2a9-10c61482a36a None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:33.251444 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 292/580] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:33.256760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32d26-6366-4b37-a779-1d5b65b6686b None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:33.257046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32d26-6366-4b37-a779-1d5b65b6686b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:33.257325 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32d26-6366-4b37-a779-1d5b65b6686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:33.277009 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-f3a32d26-6366-4b37-a779-1d5b65b6686b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:33.278202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f3a32d26-6366-4b37-a779-1d5b65b6686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:33.346806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 289/581] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:33 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:33.675864 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c2c3-2eff-4419-b2a9-10c61482a36a None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:33.781341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c2c3-2eff-4419-b2a9-10c61482a36a None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:33.815226 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:33.815858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:33.816135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:33.816400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:33.817054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:33.818431 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe6d4-6e8d-47d4-b7a9-7d776d5d8b16 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:33.836019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 293/582] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:33 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:34.987958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b8d2-44cb-4204-b442-80a8906ad238 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:34.988493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b8d2-44cb-4204-b442-80a8906ad238 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:34.988493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b8d2-44cb-4204-b442-80a8906ad238 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:34.990098 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 290/583] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:34.995696 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:34.996200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:34.996359 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:35.015932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:35.017168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:35.044323 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:35.095204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 294/584] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:35.416881 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2b8d2-44cb-4204-b442-80a8906ad238 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:35.445309 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:35.520663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2b8d2-44cb-4204-b442-80a8906ad238 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:35.563188 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:35.564255 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:35.564746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:35.565232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:35.566286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:35.568855 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:35.580749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:35.581658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:35.582679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 291/585] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 25 00:12:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:35.588394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:35.687170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d97968-06d9-42b8-9122-f0d126135fba None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:35.721794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:35.722395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:35.722669 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:35.722940 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:35.723598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:35.723897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:35.725254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:35.730252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 295/586] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:35.736209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:35.832051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:35.842004 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1ca6-5953-4ec1-a533-3131e16d0e32 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:35.877741 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:35.878355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:35.878632 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:35.878907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:35.879582 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:35.879889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:35.881271 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb705-42b1-4140-8d72-37c89d517def None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:35.888166 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 292/587] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 25 00:12:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:35.894248 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:35.920822 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:36.004858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f5b2-e4ad-43f7-af1e-243925ad1640 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:36.038726 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:36.039329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:36.039628 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:36.039893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:36.040568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:36.042639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5624e-bbc1-4263-83d2-58fabecabe38 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:36.063340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 296/588] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:36.361847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2031f-a944-4fcc-bf58-d2b29b3f9813 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:36.362590 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2031f-a944-4fcc-bf58-d2b29b3f9813 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:36.363216 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2031f-a944-4fcc-bf58-d2b29b3f9813 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:36.365742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 293/589] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:36.374688 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:36.375258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:36.375862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:36.405840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:36.407846 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:36.520869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 297/590] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:36.860198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2031f-a944-4fcc-bf58-d2b29b3f9813 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:36.973746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2031f-a944-4fcc-bf58-d2b29b3f9813 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:37.009538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:37.011276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:37.011586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:37.011859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:37.012434 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:37.013828 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:37.022619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:37.023756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:37.024672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 294/591] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:37.030865 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:37.033178 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:37.136229 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9ce4-21ff-4206-8c23-4364118e7574 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:37.169236 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:37.169836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:37.170117 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:37.170386 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:37.171013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:37.171309 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:37.172710 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:37.177579 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 298/592] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:37.188939 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:37.213989 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:37.298680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322ba8-cc46-42f6-a7cc-d08560e6e672 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:37.336945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:37.337551 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:37.337827 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:37.338101 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:37.338733 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:37.339035 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:37.340457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:37.345795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 295/593] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:12:37.351735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:37.422462 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:37.464192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0e29-d35a-4f85-adf1-ece0f53d5efc None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:37.507612 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:37.508248 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:37.508520 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:37.508787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:37.509540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] RBAC: Adding query filter params (interface=public, service_id=0a8e27d2856d49e79079418b681b430f, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:37.509879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:37.511883 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916389-7f64-47b4-bd25-35062279d81c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:37.518156 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 299/594] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:37 2022] GET /identity/v3/endpoints?service_id=0a8e27d2856d49e79079418b681b430f&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:37.524531 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:37.621138 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:37.637781 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46c34-094b-49fd-a01d-1f5a0b94e1f8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:37.676451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:37.676966 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:37.677241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:37.677509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:37.678110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:37.679495 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734c827-a4c4-4190-907c-6d50b816c42b None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:37.686428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 296/595] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:37 2022] GET /identity/v3/services => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:38.537229 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee799-85f5-4006-bb54-19a9fce565f9 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:38.537780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee799-85f5-4006-bb54-19a9fce565f9 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:38.537780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee799-85f5-4006-bb54-19a9fce565f9 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:38.539186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 300/596] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:38.545807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:38.546368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:38.546774 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:38.567958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:38.569135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:38.642439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 297/597] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:38.970024 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee799-85f5-4006-bb54-19a9fce565f9 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:39.082366 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee799-85f5-4006-bb54-19a9fce565f9 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:39.114844 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:39.121345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:39.121979 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:39.122260 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:39.122529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] PATH_INFO: `/v3/services/compute` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:39.123109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:39.124550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:39.133523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:39.135145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:39.136638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 301/598] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:39.141231 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:39.223524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:39.246517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c13f5-03e3-44fb-9d75-ed1c8a28e86d None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:39.280327 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:39.280948 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:39.281222 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:39.281488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:39.282107 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] RBAC: Adding query filter params (name=compute) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:39.282400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:39.283824 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4221-eb7d-428c-bfb3-bc8d28bbf73d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:39.288341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 298/599] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:39.294074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:39.402478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589823fe-dfa7-486b-b7ea-d3b8840ca84d None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:39.450675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:39.451286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:39.451616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:39.451889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:39.452525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:39.452828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:39.454213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0103a1-7690-4811-b9dc-b05a05dadc66 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:39.459154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 302/600] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:40.136894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3411-1bfe-4fa8-8c18-da805ddadfde None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:40.137469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3411-1bfe-4fa8-8c18-da805ddadfde None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:40.137469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3411-1bfe-4fa8-8c18-da805ddadfde None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:40.138803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 299/601] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:40.144315 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:40.144738 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:40.144855 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:40.163362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:40.164586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:40.223209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:40.238616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 303/602] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:40.564160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd3411-1bfe-4fa8-8c18-da805ddadfde None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:40.671370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd3411-1bfe-4fa8-8c18-da805ddadfde None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:40.706473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:40.707108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:40.707389 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:40.707692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:40.708278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:40.709667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:40.719722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:40.720786 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:40.721617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 300/603] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:40.726783 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:40.833836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb7ba-3a4c-45cd-a2f6-f8535169e65b None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:40.868653 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:40.870025 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:40.870307 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:40.870577 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:40.871207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:40.871536 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:40.872903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:40.877630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 304/604] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:40.883303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:40.893229 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:40.985494 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7c65-4366-467a-9399-eaa03ca57cf3 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:41.020043 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:41.020646 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:41.020922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:41.021189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:41.021806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:41.022104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:41.023538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a30e8-1974-4e2a-86e1-2db08c535dd8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:41.028734 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 301/605] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 25 00:12:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:41.034586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:41.092053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:41.140525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bef243-6092-4867-8bf2-2ec49f0bf631 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:41.173047 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:41.173705 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:41.173937 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:41.174207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:41.174870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:41.176270 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5caf74-bd8c-492d-92fb-f186ec583cc5 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:41.197395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 305/606] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:41.896540 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159601-b889-4492-a1d9-6b5cb4e873bf None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:41.897082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159601-b889-4492-a1d9-6b5cb4e873bf None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:41.897082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159601-b889-4492-a1d9-6b5cb4e873bf None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:41.898421 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 302/607] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:41.904555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d868ac-50be-4259-961d-f008fc3e3fa8 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:41.904915 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d868ac-50be-4259-961d-f008fc3e3fa8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:41.905276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d868ac-50be-4259-961d-f008fc3e3fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:41.924880 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-48d868ac-50be-4259-961d-f008fc3e3fa8 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:41.926072 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-48d868ac-50be-4259-961d-f008fc3e3fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:41.999944 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 306/608] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:41 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:42.327570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159601-b889-4492-a1d9-6b5cb4e873bf None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:42.406368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:42.443233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159601-b889-4492-a1d9-6b5cb4e873bf None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:42.477606 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:42.478219 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:42.478695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:42.479062 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:42.479755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:42.481138 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1abfc-edd1-4b64-a321-dff7db588dd3 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:42.499499 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 303/609] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:12:42 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:43.685790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ab77-4e7e-4ecd-bf35-17a7685138de None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:43.686322 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ab77-4e7e-4ecd-bf35-17a7685138de None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:43.686322 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ab77-4e7e-4ecd-bf35-17a7685138de None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:43.687586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 307/610] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:43.692926 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:43.693339 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:43.693475 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:43.711749 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:43.713081 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:43.787089 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 304/611] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:43 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 00:12:44.110652 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ab77-4e7e-4ecd-bf35-17a7685138de None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:44.147143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:44.217034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ab77-4e7e-4ecd-bf35-17a7685138de None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:44.252073 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:44.252666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:44.252939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:44.253207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:44.253848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:44.255256 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:44.257872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING keystone.server.flask.common [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 25 00:12:44.274862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.sql.core [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:44.274862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:12:44.274862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [parameters: {'id': 'd1be9fd4c5cd40f29e62fe55dd845f95', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 25 00:12:44.274862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1be9fd4c5cd40f29e62fe55dd845f95.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1be9fd4c5cd40f29e62fe55dd845f95. Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:44.282717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 00:12:44.283621 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application yield resource Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise self.value Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application session.commit() Oct 25 00:12:44.284769 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.flush() Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application compat.raise_( Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 00:12:44.285893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 00:12:44.286802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:44.287638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [parameters: {'id': 'd1be9fd4c5cd40f29e62fe55dd845f95', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:44.288529 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:44.289528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1be9fd4c5cd40f29e62fe55dd845f95. Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:44.290567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 308/612] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Oct 25 00:12:44 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:44.292742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:44.358616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:44.417593 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c298-b911-4533-998f-eeed05518fed None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:44.456317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:44.456956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:44.457232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:44.457501 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:44.465799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:44.467648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-7e1272ba-8cdc-4824-b053-735a2cb55800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:12:44.483099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:44.484177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:44.485093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 305/613] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:44.490523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:44.587681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:44.599331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6f70-12d7-4b29-9955-fce941ebfbd4 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:44.639383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:44.639895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:44.640169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:44.640461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:44.641085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:44.641382 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:44.643008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83f32-f4f0-44f8-bd08-28e5d1b9f7c3 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:44.664077 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:44.984145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b594-6f01-4322-a8be-b30b2f2a5997 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:44.984699 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b594-6f01-4322-a8be-b30b2f2a5997 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:44.984809 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b594-6f01-4322-a8be-b30b2f2a5997 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:44.986192 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 306/615] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:44.992125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:44.992590 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:44.992674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:45.015302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:45.016898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:45.091139 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 310/616] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:44 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:45.429355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b594-6f01-4322-a8be-b30b2f2a5997 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:45.544066 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b594-6f01-4322-a8be-b30b2f2a5997 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:45.569123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:45.589625 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:45.590259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:45.590536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:45.590806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] PATH_INFO: `/v3/services/compute` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:45.591387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:45.592799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:45.602203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:45.603249 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:45.605240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 307/617] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:45.609707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:45.701947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:45.725345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352819-1342-4f32-be13-c644a6fb14d4 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:45.765498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:45.766102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:45.766381 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:45.766685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:45.767273 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:45.767592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:45.768953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:45.774018 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 311/618] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:45.779840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:45.896571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c3c93-ac2c-4650-927f-35d0941eb53c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:45.940130 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:45.940750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:45.941032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:45.941304 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:45.941945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:45.942247 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:45.943668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:45.949496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 308/619] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:45.955533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:46.067177 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40c22-9169-4bce-acfb-282c16879a3b None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:46.108946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:46.109556 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:46.109832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:46.110100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:46.110797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] RBAC: Adding query filter params (interface=public, service_id=3d16c6697d754413ada311e712876893, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:46.111100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:46.112522 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2c37c-0965-47ae-af8c-115ed34026db None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:46.118008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 312/620] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:12:45 2022] GET /identity/v3/endpoints?service_id=3d16c6697d754413ada311e712876893&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:46.124396 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:46.171958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:46.239360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a81f-97f6-4c2c-b70e-51f18f161f57 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:46.273822 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:46.274423 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:46.274704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:46.274977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:46.276659 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:46.278846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e7aa-f4ce-42ef-9bb9-d7c468b14f17 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:46.285093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 309/621] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:12:46 2022] GET /identity/v3/services => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:12:47.156938 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576891a-5406-4b08-9dcb-4c467b442876 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:47.157477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576891a-5406-4b08-9dcb-4c467b442876 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:47.157477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576891a-5406-4b08-9dcb-4c467b442876 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:47.158795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 313/622] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:47.164204 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:47.164652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:47.164833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:47.184244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:47.185437 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:47.263846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 310/623] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:47 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:47.597451 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576891a-5406-4b08-9dcb-4c467b442876 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:47.608960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:47.703999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576891a-5406-4b08-9dcb-4c467b442876 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:47.740781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:47.741397 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:47.741701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:47.741970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:47.742620 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:47.744704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:47.759459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.sql.core [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 00:12:47.759459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 25 00:12:47.759459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [parameters: {'user_id': 'a68292d8b79846f2adc74912c3e02c94', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 25 00:12:47.759459 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:47.766078 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:47.766961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application yield resource Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application next(self.gen) Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise self.value Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application session.commit() Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 00:12:47.768056 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.session.flush() Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application compat.raise_( Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 00:12:47.768913 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 00:12:47.769869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application conn.query(q) Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application result.read() Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 00:12:47.770731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a68292d8b79846f2adc74912c3e02c94', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:47.771582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 25 00:12:47.772409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:12:47.773331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 314/624] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 25 00:12:47 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:47.773728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:47.813918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:47.880968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd1a9-70ac-48f4-b16a-4007e1761f72 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:47.920499 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297210-652f-4307-b8a4-3819f398795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:47.921274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297210-652f-4307-b8a4-3819f398795f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:47.921643 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297210-652f-4307-b8a4-3819f398795f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:47.921982 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297210-652f-4307-b8a4-3819f398795f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:47.930397 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297210-652f-4307-b8a4-3819f398795f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:47.932569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297210-652f-4307-b8a4-3819f398795f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-09297210-652f-4307-b8a4-3819f398795f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:12:47.945778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:47.946840 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:47.948117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 311/625] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:12:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:47.953970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:48.028720 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:48.062126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dabca-04f1-49cf-924d-9d40618bf457 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:48.098706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:48.099312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:48.099619 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:48.099890 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:48.100600 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:48.100895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:48.102531 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50408e-bcfa-4645-97c8-c5df465af026 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:48.142516 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 315/626] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 25 00:12:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:48.732372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249227-6a03-4f78-9dac-50dba5f79af6 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:48.732924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249227-6a03-4f78-9dac-50dba5f79af6 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:48.732924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249227-6a03-4f78-9dac-50dba5f79af6 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:48.734275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 312/627] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:12:48.740364 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:48.740872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:48.740976 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:48.761451 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:12:48.762981 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:12:48.830382 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 316/628] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:12:48 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:12:49.154438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249227-6a03-4f78-9dac-50dba5f79af6 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:49.253065 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:49.257881 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249227-6a03-4f78-9dac-50dba5f79af6 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:49.291660 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:49.292291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:49.292568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:49.292838 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] PATH_INFO: `/v3/services/compute` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:49.293415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:49.294787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:12:49.303493 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:12:49.304668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:12:49.305536 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 313/629] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:12:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:12:49.311756 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:49.373040 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:49.415869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d70de-2ee4-48ba-8205-811f3e4bbb5f None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:49.453670 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:49.454246 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:49.454525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:49.454796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:49.455443 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:49.455754 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:49.457136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:49.462013 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 317/630] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:49.468729 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:49.569577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c975-6c6e-40ae-abe0-9afefdc22adc None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:49.603234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:49.603890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:49.604168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:49.604439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:49.605059 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:12:49.605377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:49.606742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cb43e-a239-4037-8d72-c0e98e9cca28 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:49.611439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 314/631] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 25 00:12:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:12:49.617234 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:12:49.718868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679cf6-4691-476d-9cab-30091b54dc30 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:12:49.744544 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:49.757903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:12:49.758536 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:12:49.758950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:12:49.759230 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:12:49.760975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:12:49.762350 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42446f3-c018-4722-89e2-8ffc38197d68 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:12:49.784583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 318/632] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:12:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:12:59.609233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=87 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:12:59.779457 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=10,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:13:56.988408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a8b6-7502-4b64-b88e-2691ac7dc44f None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:13:56.989302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a8b6-7502-4b64-b88e-2691ac7dc44f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:13:56.989302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a8b6-7502-4b64-b88e-2691ac7dc44f None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:13:56.991488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 315/633] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:13:56.999749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:13:57.000680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:13:57.000680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:13:57.022948 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:13:57.024471 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:13:57.173814 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 319/634] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:13:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:13:57.609042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a8b6-7502-4b64-b88e-2691ac7dc44f None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:13:57.778843 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a8b6-7502-4b64-b88e-2691ac7dc44f None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:13:57.826107 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:13:57.826846 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:13:57.827162 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:13:57.827483 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:13:57.841283 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:13:57.842964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:13:57.868259 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:13:57.870829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:13:57.872999 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:13:57.872999 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:13:57.872999 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:13:57.872999 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 316/635] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:13:57.881158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:13:58.038766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8e97-cc63-4df0-a53e-6e3e288a1a8e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:13:58.084520 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:13:58.097916 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:13:58.098632 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:13:58.098932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:13:58.099205 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:13:58.099888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:13:58.100194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:13:58.101787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbed80-b082-44d0-96c2-938acee268e9 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:13:58.123809 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 320/636] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:13:58.130453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:13:58.219230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:13:58.291902 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06827-c4e4-4554-bf1d-caa84bf37bfc None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:13:58.342085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:13:58.343265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:13:58.343824 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:13:58.344398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:13:58.345889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:13:58.349271 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321b0f-9ef5-4613-8e6a-f804612e78c7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:13:58.403466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 317/637] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 25 00:13:58 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:14:01.107135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0248ba-7fa1-427b-9015-5b8dde902094 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:01.107728 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0248ba-7fa1-427b-9015-5b8dde902094 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:01.107993 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0248ba-7fa1-427b-9015-5b8dde902094 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:01.110148 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 321/638] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:01.116906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:01.117443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:01.117443 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:01.136225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:01.137468 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:01.211759 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 318/639] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:01.599239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0248ba-7fa1-427b-9015-5b8dde902094 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:01.719689 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0248ba-7fa1-427b-9015-5b8dde902094 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:01.765418 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:01.766290 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:01.766747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:01.767220 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:01.784094 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:14:01.790134 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:01.792604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:01.794204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 322/640] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:01.798692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:01.848200 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:01.923746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e680-93ba-4994-9913-075fe5381960 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:01.974286 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:01.974851 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:01.975175 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:01.975582 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:01.976472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] RBAC: Adding query filter params (name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:01.976820 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:01.978414 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:01.988411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 319/641] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:14:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:01.994960 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:02.193706 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:02.263785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e537bb-ac35-4399-a672-e2eca33d4916 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:02.310848 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:02.311650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:02.312054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:02.312432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:02.329451 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:02.333977 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:02.354523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:02.355918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:02.356957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:02.356957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:02.356957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:02.356957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 323/642] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:02.362472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:02.488427 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:02.492516 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecebcd-9215-4a7d-a7ae-a0231a2f95cb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:02.539806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:02.540446 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:02.540890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:02.541305 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:02.542120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:02.542544 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:02.544289 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:02.563362 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 320/643] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:14:02.571742 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:02.732258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:02.738244 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5157fd-9671-4a0a-9d99-764b300e33ca None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:02.788278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:02.788926 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:02.789198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:02.789467 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:02.800126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:02.801635 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:14:02.821291 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:02.822774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:02.824016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 324/644] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:02.830930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:02.994170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031279a-3705-4ff4-bd7f-dc736cbe2daf None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:03.058193 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:03.058979 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:03.059352 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:03.059778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:03.060745 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:03.061221 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:03.063398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:03.091003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 321/645] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 25 00:14:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:03.097739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:03.226175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d194-f7e6-4012-9e03-5559a3b08a3c None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:03.265734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:03.266404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:03.266697 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:03.266965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:03.278914 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:03.280521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:03.297768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:03.299111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:03.300321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:03.300321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:03.300321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:03.300321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 325/646] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:03.304920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:03.329673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:03.428517 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c610-413d-4ca0-96ca-647ac2b68642 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:03.471225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:03.472157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:03.472438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:03.472713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:03.473376 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:03.473678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:03.475123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:03.496116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 322/647] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:14:03.505342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:03.526353 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:03.641335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6026-45d7-468e-a3e5-28f06946a0b2 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:03.692413 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:03.693048 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:03.693342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:03.693595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:03.705282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:03.705282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:14:03.719400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:03.720596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:03.721712 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 326/648] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:03.727367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:03.830455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:03.858085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce775f9-1911-487a-b5dc-c352421f4f8c None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:03.905326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:03.906142 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:03.906525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:03.906939 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:03.907806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:03.908239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:03.910333 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ec22-658d-4db4-9c0b-939d66defa1b None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:03.931114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 323/649] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:03.939718 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:04.044395 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:04.079648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8391-b816-44c3-81bf-ad1184e21f48 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:04.121384 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:04.122176 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:04.122567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:04.122838 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/cb5fdcf4cde3435d9dfdd4d495ae0558/roles/0c52a4367912425ea04f302b400ee02f` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:04.141125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=cb5fdcf4cde3435d9dfdd4d495ae0558, role_id=0c52a4367912425ea04f302b400ee02f)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:04.143147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b9bde-90f2-4548-84ac-4f45a3862891 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:04.157670 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 327/650] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:14:03 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/cb5fdcf4cde3435d9dfdd4d495ae0558/roles/0c52a4367912425ea04f302b400ee02f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:14:06.923652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924eb8-a20b-4ce9-b8a3-0c619fdf7ec8 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:06.924373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924eb8-a20b-4ce9-b8a3-0c619fdf7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:06.924373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924eb8-a20b-4ce9-b8a3-0c619fdf7ec8 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:06.925851 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 324/651] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:06.935126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:06.936129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:06.936129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:06.960303 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:06.961548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:07.052841 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 328/652] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:07.421174 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68924eb8-a20b-4ce9-b8a3-0c619fdf7ec8 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:07.559262 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68924eb8-a20b-4ce9-b8a3-0c619fdf7ec8 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:07.598933 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:07.600085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:07.600492 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:07.600850 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:07.610298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:07.615692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:14:07.623337 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:07.624514 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:07.625530 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 325/653] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 25 00:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:07.631577 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:07.689375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:07.758887 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bb367-866b-4bd3-a2e4-77d833d3c2fb None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:07.804694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:07.806171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:07.806930 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:07.807488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:07.809051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] RBAC: Adding query filter params (name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:07.809727 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:07.812474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:07.826745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 329/654] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 25 00:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:07.834303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:07.987924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ed68d-64a5-40e2-b7c2-815f5e425fb9 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:08.053356 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:08.054445 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:08.054922 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:08.055412 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:08.073284 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:08.075195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:08.097490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:08.103637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:08.106438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:08.106438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:08.106438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:08.106438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 326/655] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:08.110393 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:08.269806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9df0-db15-49a3-a08a-179c6af734bc None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:08.287478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:08.321819 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:08.324128 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:08.324638 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:08.325145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:08.326599 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:08.327300 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:08.330488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:08.354680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 330/656] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:08.361833 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:08.427792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:08.499407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37061823-8218-42aa-b292-acbac93111c6 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:08.550676 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:08.551580 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:08.551872 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:08.552308 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:08.562399 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:08.563665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:14:08.577213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:08.579032 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:08.580896 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 327/657] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:08.586394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:08.734130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd8970-fcae-46d4-b8c2-c031c40ced67 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:08.785143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:08.786209 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:08.786733 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:08.787223 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:08.788738 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:08.789325 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:08.792792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:08.821660 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 331/658] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 25 00:14:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:08.827791 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:08.996751 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b49800-34bb-4466-ae8d-ec853ac953c8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:09.018622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:09.051580 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:09.052571 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:09.053042 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:09.053688 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:09.143044 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:09.144654 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:09.285340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 328/659] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:14:08 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 00:14:09.292196 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:09.330569 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:09.415636 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cac15-1ff1-4b2a-9060-1829e765ea62 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:09.455380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:09.456065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:09.456369 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:09.456665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:09.469476 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:09.470950 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:09.489595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:09.490959 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:09.492046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:09.492046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:09.492046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:09.492046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 332/660] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:09.498643 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:09.512195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:09.634534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aaa01-0239-4b56-bb03-30dc2817bd61 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:09.688273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:09.688844 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:09.689124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:09.689404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:09.690084 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:09.690392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:09.691945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:09.709636 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 329/661] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:09.716211 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:09.821920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:09.842879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a742f-b3d3-4e88-ad14-2945eb3bb222 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:09.886146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:09.886974 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:09.887254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:09.887558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:09.894622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:09.896105 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:14:09.913282 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:09.914276 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:09.915171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 333/662] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:09.923168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:10.029756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:10.064129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbe6e-5555-47f3-8459-f576bf77e6a7 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:10.102110 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:10.102751 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:10.103038 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:10.103373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:10.104898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:10.105211 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:10.106849 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e042-78c2-429e-a963-d9120b24d7f7 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:10.121854 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 330/663] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:10.128349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:10.247991 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0947d8-1353-42c7-a158-54a4ae3a1cbf None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:10.288283 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:10.288844 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:10.289126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:10.289398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:10.290133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] RBAC: Adding query filter params (role.id=0c52a4367912425ea04f302b400ee02f, scope.project.id=18e3856a84cc407da62696542e957775, user.id=cb5fdcf4cde3435d9dfdd4d495ae0558) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:10.290441 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:10.291956 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0e26-7638-4f2e-a475-e179d514eefd None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:10.298622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 334/664] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:14:10 2022] GET /identity/v3/role_assignments?user.id=cb5fdcf4cde3435d9dfdd4d495ae0558&scope.project.id=18e3856a84cc407da62696542e957775&role.id=0c52a4367912425ea04f302b400ee02f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:13.112871 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc10a-7a21-47f0-94be-2626126b9766 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:13.113732 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc10a-7a21-47f0-94be-2626126b9766 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:13.113732 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc10a-7a21-47f0-94be-2626126b9766 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:13.114763 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 331/665] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:13.127873 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:13.128711 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:13.128970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:13.146145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:13.154547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:13.156445 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:13.251953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 335/666] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:13.604317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc10a-7a21-47f0-94be-2626126b9766 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:13.750815 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc10a-7a21-47f0-94be-2626126b9766 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:13.797160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:13.805638 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:13.807608 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:13.808351 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:13.808757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:13.822120 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:14:13.827527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:13.828587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:13.829428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 332/667] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:13.837154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:13.992445 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1080b-0895-4754-b71a-9ed6a1f6e91d None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:14.039911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:14.040527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:14.040826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:14.041719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:14.042438 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:14.042759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:14.044249 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:14.047075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:14.055387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 336/668] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:14.062027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:14.194655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ae919-8b40-4292-90bf-b7a066b1ad65 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:14.238244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:14.239276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:14.239656 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:14.239973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:14.252740 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:14.254669 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:14.274626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:14.277159 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:14.279250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:14.279250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:14.279250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:14.279250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 333/669] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:14.284098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:14.407665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce917-171b-41c6-87b4-87102ea20fbf None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:14.447829 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:14.448918 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:14.449328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:14.449617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:14.450314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:14.450616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:14.452201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:14.466496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 337/670] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:14.473051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:14.545438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:14.630150 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f61b4-87ce-4899-8082-985928fbe9b8 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:14.680587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:14.681576 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:14.683135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:14.683589 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] PATH_INFO: `/v3/users/placement` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:14.694241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:14.696123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:14:14.713792 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:14.715800 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:14.717680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 334/671] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:14.724166 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:14.811237 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:14.874077 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d0ab-c5c7-40ff-8909-ed4fad9a84ed None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:14.926407 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:14.927372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:14.927892 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:14.928376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:14.929650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:14.930175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:14.932901 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:14.968657 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 338/672] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 25 00:14:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:14.981489 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:15.152434 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04661be-d2d8-4fde-8fa1-ec75441b1ebb None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:15.154684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:15.203511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:15.204695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:15.205218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:15.205814 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:15.225882 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:15.227500 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:15.244010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:15.250560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:15.251714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:15.251714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:15.251714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:15.251714 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:15.253490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:15.375272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4813-01e9-49d3-81da-6cbd7693d680 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:15.402683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:15.429293 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:15.430424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:15.430786 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:15.431277 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:15.432635 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:15.433252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:15.435055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:15.450684 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 339/674] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:15.457950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:15.577453 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831325-044f-4473-a802-185d3ad684b9 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:15.618368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:15.619008 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:15.620109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:15.620859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:15.632661 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:15.634436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:14:15.650205 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:15.651579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:15.652720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:15.653284 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 336/675] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:15.659767 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:15.796292 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444319a-8e64-47b6-82c9-876117933115 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:15.840939 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:15.841626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:15.841902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:15.842397 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:15.843001 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:15.843302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:15.845253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c9710-368c-4ab1-8333-3781ea4f241c None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:15.861589 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 340/676] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:15.869418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:15.895617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:16.012081 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90082-01f5-40d5-b083-ae0f60fb8861 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:16.049598 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:16.050201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:16.050470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:16.050738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] PATH_INFO: `/v3/projects/18e3856a84cc407da62696542e957775/users/cb5fdcf4cde3435d9dfdd4d495ae0558/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:16.052739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e3856a84cc407da62696542e957775, user_id=cb5fdcf4cde3435d9dfdd4d495ae0558, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:16.054281 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4f10-17a8-43f4-8c77-a37381434a31 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:16.067364 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 337/677] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 25 00:14:15 2022] PUT /identity/v3/projects/18e3856a84cc407da62696542e957775/users/cb5fdcf4cde3435d9dfdd4d495ae0558/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:14:18.644085 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85a4f-9f0a-4bdf-9c30-f1cb35eec47e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:18.644922 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85a4f-9f0a-4bdf-9c30-f1cb35eec47e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:18.644922 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85a4f-9f0a-4bdf-9c30-f1cb35eec47e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:18.646263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 341/678] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:14:18.653548 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:18.654127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:18.654449 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:18.684645 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:18.686624 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:18.773930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 338/679] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:19.118443 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85a4f-9f0a-4bdf-9c30-f1cb35eec47e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:19.164833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:19.250713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85a4f-9f0a-4bdf-9c30-f1cb35eec47e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:19.300876 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:19.301975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:19.302457 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:19.302925 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:19.318675 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 00:14:19.323957 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:19.325123 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:19.326199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 342/680] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 25 00:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:19.335276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:19.341034 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:19.468068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517abcb-bd5b-48da-81d7-c9358b3054bb None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:19.511414 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:19.512079 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:19.512360 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:19.512634 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:19.513315 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:19.513622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:19.515063 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:19.525004 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 339/681] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 25 00:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:19.531402 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:19.640064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:19.646406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5474-eb99-4842-8f23-bc9299267984 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:19.684043 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:19.684686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:19.684973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:19.685243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:19.696441 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:19.698485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:19.717919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:19.719797 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:19.720870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:19.720870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:19.720870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:19.720870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 343/682] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:19.726283 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:19.801563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:19.842616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba9749-751e-4f16-a0b5-c6989ad68475 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:19.879326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:19.879977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:19.880260 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:19.880534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] PATH_INFO: `/v3/domains` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:19.881189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:19.881496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:19.882889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:19.895980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 340/683] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:14:19.902548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:20.017760 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a487e60-5a20-41dd-9e9c-63677ee3ad35 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:20.052954 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:20.053583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:20.053861 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:20.054143 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:20.062257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:20.063756 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 00:14:20.076136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:20.077805 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:20.079265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 344/684] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:20.083596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:20.190717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683160-1dbb-45da-b12f-63733b2c9d0d None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:20.218698 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:20.229887 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:20.230524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:20.230806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:20.231077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:20.231891 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:20.232190 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:20.233704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:20.255171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 341/685] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 25 00:14:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:14:20.262196 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:20.273820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:20.428453 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58a802-b4ed-44aa-a2b3-a80917351678 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:20.475112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:20.475746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:20.476026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:20.476302 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:20.546688 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:20.548169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:20.558563 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:20.662250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 345/686] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 25 00:14:20 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 25 00:14:20.669117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:20.780473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb185b-11f8-4cbe-bbdf-48b112e3c1db None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:20.816520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:20.817154 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:20.817431 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:20.817702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:20.828664 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:20.830153 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 00:14:20.845496 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:20.846750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 00:14:20.847941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 00:14:20.847941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 00:14:20.847941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:20.847941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 342/687] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:20.852756 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:20.960281 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473760-b77b-4d27-b8bb-c3275c8d1c8e None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:20.972636 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:21.000528 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:21.001138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:21.001419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:21.001685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:21.002325 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:21.002626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:21.004053 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:21.016404 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 346/688] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 25 00:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:21.022355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:21.060078 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:21.128245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0cbbe-2d6d-4b25-a8a0-b83cb83ae05a None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:21.163257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:21.163917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:21.164199 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:21.164472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:21.171895 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:21.173373 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 00:14:21.185465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:21.186689 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: ERROR keystone.server.flask.application Oct 25 00:14:21.187667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 343/689] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 25 00:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 00:14:21.192900 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:21.304131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f57eb-1c67-4d00-842c-ac9c42ca7aaa None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:21.339674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:21.340201 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:21.340477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:21.340745 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:21.341449 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:21.341757 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:21.343214 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ff470-84f4-4bd6-88a7-7a24fc4149f4 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:21.357934 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 347/690] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 25 00:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:21.366073 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:21.468692 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:21.475757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654eeb8-13cd-4079-a7a4-2182858c75ae None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:21.511982 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:21.512660 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:21.512941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:21.513263 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:21.513993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] RBAC: Adding query filter params (role.id=70e01e34b4914943a949ed0ea649288a, scope.project.id=18e3856a84cc407da62696542e957775, user.id=cb5fdcf4cde3435d9dfdd4d495ae0558) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:21.514626 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:21.515782 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8a7e-f666-4bc8-b0af-90646bf7803d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:21.521970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 344/691] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 25 00:14:21 2022] GET /identity/v3/role_assignments?user.id=cb5fdcf4cde3435d9dfdd4d495ae0558&scope.project.id=18e3856a84cc407da62696542e957775&role.id=70e01e34b4914943a949ed0ea649288a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:24.004213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdb12-0f6c-402b-a458-5600807885f8 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:24.005033 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdb12-0f6c-402b-a458-5600807885f8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:24.005033 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdb12-0f6c-402b-a458-5600807885f8 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:24.006239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 348/692] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:24.014318 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:24.014889 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:24.015301 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:24.042899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:24.044879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:24.133686 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 345/693] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:24.455472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdb12-0f6c-402b-a458-5600807885f8 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:24.485774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:24.564026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdb12-0f6c-402b-a458-5600807885f8 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:24.598791 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:24.599506 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:24.599816 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:24.600122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:24.600768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:24.602156 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:24.611677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:24.614839 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:24.615992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 349/694] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 25 00:14:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:24.618757 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:24.717080 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:24.730180 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e0310-44fc-4cc5-8913-c255b0014b39 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:24.765795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:24.766398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:24.766674 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:24.766943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:24.767593 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] RBAC: Adding query filter params (name=placement) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:24.767890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:24.769253 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7788f-02a8-455a-9767-35bb79b7e10f None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:24.773900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 346/695] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 25 00:14:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:24.780678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:24.885597 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:24.895173 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8e8d7-d752-4cb6-aace-c3e39af8a123 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:24.929886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:24.930719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:24.931186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:24.931452 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] PATH_INFO: `/v3/services` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:24.933432 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] RBAC: Adding query filter params (type=placement) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:24.933728 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:24.935403 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3e19d-464f-4dee-94af-b0873fb28b58 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:24.941684 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 350/696] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 25 00:14:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:27.367690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba6bc-6f4d-4991-83d0-bf47dad57413 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:27.368278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba6bc-6f4d-4991-83d0-bf47dad57413 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:27.368278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba6bc-6f4d-4991-83d0-bf47dad57413 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:27.370137 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 347/697] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:27.375828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d7af-3231-41f3-81bd-f55cc651552c None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:27.376358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d7af-3231-41f3-81bd-f55cc651552c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:27.376358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d7af-3231-41f3-81bd-f55cc651552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:27.395794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ed24d7af-3231-41f3-81bd-f55cc651552c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:27.396954 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ed24d7af-3231-41f3-81bd-f55cc651552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:27.466504 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 351/698] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 00:14:27.788246 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba6bc-6f4d-4991-83d0-bf47dad57413 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:27.894446 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba6bc-6f4d-4991-83d0-bf47dad57413 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:27.932970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:27.933902 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:27.934195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:27.934469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:27.935372 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:27.937425 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cd16e-c539-4ba9-b0fc-02e7535ab3c9 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:27.958655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 348/699] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 25 00:14:27 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:14:30.405016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f528-9798-47b6-be08-116d2896f246 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:30.405570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f528-9798-47b6-be08-116d2896f246 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:30.405570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f528-9798-47b6-be08-116d2896f246 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:30.407026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 352/700] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:30.415505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:30.416114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:30.416213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:30.437711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:30.439085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:30.451662 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:30.523982 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 349/701] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:30 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:30.851889 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f528-9798-47b6-be08-116d2896f246 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:30.940836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:30.959466 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f528-9798-47b6-be08-116d2896f246 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:31.006047 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:31.006776 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:31.007077 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:31.007408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:31.008070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:31.009613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:31.020224 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:31.021349 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:31.022172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 353/702] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 25 00:14:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:31.028490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:31.129256 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb342d-b5c1-4040-a416-47c79b7680e1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:31.164170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:31.164775 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:31.165053 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:31.165320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:31.165948 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:31.166930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:31.168584 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:31.174600 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 350/703] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 25 00:14:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:14:31.180896 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:31.287001 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa184c-34fe-48a6-9344-ffc6e8052037 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:31.322007 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:31.322707 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:31.322990 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:31.323260 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:31.323986 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] RBAC: Adding query filter params (interface=public, service_id=cd232fa70ef54d48ab25ea132a1e5b1d, region_id=RegionOne) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:31.324294 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:31.325665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbaeb9-b8ef-4ca1-be1b-619488f20607 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:31.330692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 354/704] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 25 00:14:31 2022] GET /identity/v3/endpoints?service_id=cd232fa70ef54d48ab25ea132a1e5b1d&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:31.336411 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:31.340700 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:31.439675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2800b-2e6e-4840-b82f-c4e1ac7f0f80 None admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:31.474026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:31.474628 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:31.474906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:31.475177 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:31.475807 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:31.477171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cb12b-8527-44fb-9d97-df75a1ae732d None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:31.483872 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 351/705] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 25 00:14:31 2022] GET /identity/v3/services => generated 1962 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:14:33.936648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4a1c-540d-461f-b916-97f3afe85c53 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:33.937439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4a1c-540d-461f-b916-97f3afe85c53 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:33.937439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4a1c-540d-461f-b916-97f3afe85c53 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:33.938535 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 355/706] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:14:33.945452 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:33.946114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:33.946114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:33.968942 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:14:33.970335 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:14:34.055977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:34.062485 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 352/707] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:14:33 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 00:14:34.391490 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4a1c-540d-461f-b916-97f3afe85c53 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:34.409132 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:34.506255 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4a1c-540d-461f-b916-97f3afe85c53 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:34.542622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:34.543313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:34.543619 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:34.543896 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:34.544487 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:34.545898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 00:14:34.555088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 00:14:34.556949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application with Lock( Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self._enter() Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application return self.creator() Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application created_value = creator( Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: ERROR keystone.server.flask.application Oct 25 00:14:34.559380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 356/708] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 25 00:14:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 00:14:34.563157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:34.664191 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63c8e-85e5-4958-8b3a-0f0689e57545 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:34.699803 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:34.700428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:34.700709 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:34.700987 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] PATH_INFO: `/v3/services` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:34.701620 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:14:34.701924 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:34.703308 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef697ba0-07dc-4ccf-bcd8-25c8a882d3b2 None admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:34.708974 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 353/709] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 25 00:14:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:14:34.714893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:14:34.800827 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:34.825735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac938a55-4c24-4e3a-a6d9-5d042975ea87 None admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:14:34.862780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:14:34.863388 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:14:34.863701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:14:34.863972 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:14:34.864640 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:14:34.866003 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaf444-cb0d-4a8e-ac60-2a83782e17e3 None admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:14:34.887045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 357/710] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:14:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:14:44.706160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=69 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:14:44.882425 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:15:39.051761 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2368-804f-4bf2-a636-91eac83004a1 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:39.052534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2368-804f-4bf2-a636-91eac83004a1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:39.053123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2368-804f-4bf2-a636-91eac83004a1 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:39.054551 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 354/711] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:39.060308 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760663d-14bb-4c02-8118-8ca0baf6b06c None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:39.060872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760663d-14bb-4c02-8118-8ca0baf6b06c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:39.060872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760663d-14bb-4c02-8118-8ca0baf6b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:39.082178 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2760663d-14bb-4c02-8118-8ca0baf6b06c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:39.084294 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2760663d-14bb-4c02-8118-8ca0baf6b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:39.205919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 358/712] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:39.547515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def9aa-1399-44a4-85c3-b2d6597fd5ea None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:39.547899 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def9aa-1399-44a4-85c3-b2d6597fd5ea None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:39.548257 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def9aa-1399-44a4-85c3-b2d6597fd5ea None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:39.549696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 355/713] 10.222.0.18 () {54 vars in 964 bytes} [Tue Oct 25 00:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:39.557620 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c5c8d-5fa8-4875-8e7d-6f1a043a2f8e None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:39.557899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c5c8d-5fa8-4875-8e7d-6f1a043a2f8e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:39.558176 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c5c8d-5fa8-4875-8e7d-6f1a043a2f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:39.627945 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-5a4c5c8d-5fa8-4875-8e7d-6f1a043a2f8e None None] MFA Rules not processed for user `ac44864c41224ca58e8a489209f878c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:39.629062 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-5a4c5c8d-5fa8-4875-8e7d-6f1a043a2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:39.694114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 359/714] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Oct 25 00:15:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:39.703189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25def9aa-1399-44a4-85c3-b2d6597fd5ea None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:39.714142 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25def9aa-1399-44a4-85c3-b2d6597fd5ea None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:39.717615 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:39.718215 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:39.718492 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:39.718760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:39.729379 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:39.730806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40304-5ee7-4963-ba56-8719288d5a18 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:39.741435 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 356/715] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:42.494984 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec564a-d8c7-4315-8604-b7bceaa58f12 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:42.495681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec564a-d8c7-4315-8604-b7bceaa58f12 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:42.495681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec564a-d8c7-4315-8604-b7bceaa58f12 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:42.497133 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 360/716] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:42.502816 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ac39-955b-4e6a-8c2d-7cda6ad4719e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:42.503404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ac39-955b-4e6a-8c2d-7cda6ad4719e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:42.503404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ac39-955b-4e6a-8c2d-7cda6ad4719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:42.525383 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-bfe1ac39-955b-4e6a-8c2d-7cda6ad4719e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:42.526879 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-bfe1ac39-955b-4e6a-8c2d-7cda6ad4719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:42.535551 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 357/717] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:42.900759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c174-9127-4c29-81af-28398c074935 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:42.901052 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c174-9127-4c29-81af-28398c074935 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:42.901489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c174-9127-4c29-81af-28398c074935 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:42.903206 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 361/718] 10.222.0.18 () {54 vars in 964 bytes} [Tue Oct 25 00:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:42.909415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cc57-4f31-453f-b3d4-2b86a6bff4db None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:42.909771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cc57-4f31-453f-b3d4-2b86a6bff4db None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:42.910116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cc57-4f31-453f-b3d4-2b86a6bff4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:42.932114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-9708cc57-4f31-453f-b3d4-2b86a6bff4db None None] MFA Rules not processed for user `ac44864c41224ca58e8a489209f878c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:42.933407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-9708cc57-4f31-453f-b3d4-2b86a6bff4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:42.940028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 358/719] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Oct 25 00:15:42 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:42.949152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c174-9127-4c29-81af-28398c074935 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:42.962067 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c174-9127-4c29-81af-28398c074935 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:42.965561 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:42.966163 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:42.966435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:42.966704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:42.977426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:42.979017 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816483c-ed15-43f3-8f1f-443c438f54fb service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:42.990895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 362/720] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:46.032083 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d621-d723-4258-87b3-6df52c9e77d7 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:46.032506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d621-d723-4258-87b3-6df52c9e77d7 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:46.032635 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d621-d723-4258-87b3-6df52c9e77d7 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:46.033969 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 359/721] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:46.040019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b5b6-3d5e-4b63-b55d-f186d48aa31f None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:46.040401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b5b6-3d5e-4b63-b55d-f186d48aa31f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:46.040671 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b5b6-3d5e-4b63-b55d-f186d48aa31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:46.080250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-c606b5b6-3d5e-4b63-b55d-f186d48aa31f None None] MFA Rules not processed for user `655bb4b1929d44379b34bd4f0b344b86`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:46.081369 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-c606b5b6-3d5e-4b63-b55d-f186d48aa31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:46.122472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:15:46.150828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 363/722] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:46 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:46.491935 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d621-d723-4258-87b3-6df52c9e77d7 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:46.502570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d621-d723-4258-87b3-6df52c9e77d7 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:46.506874 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:46.507503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:46.507785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:46.508061 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:46.517524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:46.518959 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ec23-c2a6-476b-85f1-bd49196a8476 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:46.529491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 360/723] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:46 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:49.459613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de681d7c-a650-4496-b7a5-966fa4b699dd None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:49.460184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de681d7c-a650-4496-b7a5-966fa4b699dd None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:49.460184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de681d7c-a650-4496-b7a5-966fa4b699dd None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:49.461537 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 364/724] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:15:49.467160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed218-0ef1-45f6-a727-fbb10f67dd37 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:49.467655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed218-0ef1-45f6-a727-fbb10f67dd37 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:49.467816 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed218-0ef1-45f6-a727-fbb10f67dd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:49.487839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-417ed218-0ef1-45f6-a727-fbb10f67dd37 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:49.489837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-417ed218-0ef1-45f6-a727-fbb10f67dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:49.558407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 361/725] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:49 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:49.892232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de681d7c-a650-4496-b7a5-966fa4b699dd None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:49.903862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de681d7c-a650-4496-b7a5-966fa4b699dd None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:49.907247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:49.907869 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:49.908142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:49.908405 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:49.917392 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:49.918804 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b112fc1-a166-4868-ad41-6a0af8b2ea37 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:49.928168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 365/726] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:49 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:53.021726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41febb-349a-4d09-8e1f-f80c2d5bafca None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:53.022267 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41febb-349a-4d09-8e1f-f80c2d5bafca None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:53.022267 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41febb-349a-4d09-8e1f-f80c2d5bafca None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:53.023641 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 362/727] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:53.029119 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df32e-36e5-4b1e-b4ff-fbba3fa24915 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:53.029552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df32e-36e5-4b1e-b4ff-fbba3fa24915 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:53.029669 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df32e-36e5-4b1e-b4ff-fbba3fa24915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:53.049408 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d75df32e-36e5-4b1e-b4ff-fbba3fa24915 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:53.050592 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d75df32e-36e5-4b1e-b4ff-fbba3fa24915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:53.058653 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 366/728] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:53.403382 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41febb-349a-4d09-8e1f-f80c2d5bafca None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:53.414684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41febb-349a-4d09-8e1f-f80c2d5bafca None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:53.418718 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:53.419321 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:53.419644 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:53.419916 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:53.430012 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:53.431491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5291e-12e7-4abe-a0b5-9dd57214f82b service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:53.443007 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 363/729] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:55.938717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992212-da8f-4910-afd5-31f7f3f9c4ee None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:55.939254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992212-da8f-4910-afd5-31f7f3f9c4ee None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:55.939254 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992212-da8f-4910-afd5-31f7f3f9c4ee None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:55.940747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 367/730] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:55.946366 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978100fe-0b38-474a-9a3b-772011b32864 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:55.946852 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978100fe-0b38-474a-9a3b-772011b32864 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:55.946955 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978100fe-0b38-474a-9a3b-772011b32864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:55.966084 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-978100fe-0b38-474a-9a3b-772011b32864 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:55.967278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-978100fe-0b38-474a-9a3b-772011b32864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:55.975985 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 364/731] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:56.312648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81992212-da8f-4910-afd5-31f7f3f9c4ee None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:56.323662 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81992212-da8f-4910-afd5-31f7f3f9c4ee None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:56.327364 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:56.327994 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:56.328268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:56.328537 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:56.338947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:56.340464 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e6831-7455-44f1-8446-4c5c022afab5 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:56.352513 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 368/732] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:15:58.857796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef8cb-4895-4b7a-9176-43f1c7db0443 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:58.858363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef8cb-4895-4b7a-9176-43f1c7db0443 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:58.858363 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef8cb-4895-4b7a-9176-43f1c7db0443 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:58.859679 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 365/733] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:15:58.864999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999d33-e693-48e3-8858-b7defe719b1c None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:58.865435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999d33-e693-48e3-8858-b7defe719b1c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:58.865543 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999d33-e693-48e3-8858-b7defe719b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:58.886016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-c3999d33-e693-48e3-8858-b7defe719b1c None None] MFA Rules not processed for user `655bb4b1929d44379b34bd4f0b344b86`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:15:58.887203 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-c3999d33-e693-48e3-8858-b7defe719b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:15:58.895197 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 369/734] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:15:58 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:15:59.233236 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef8cb-4895-4b7a-9176-43f1c7db0443 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:15:59.245505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef8cb-4895-4b7a-9176-43f1c7db0443 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:15:59.249407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:15:59.250118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:15:59.250465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:15:59.250815 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:15:59.261184 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:15:59.262624 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7022-9b4a-4b91-bfdb-149c27b98760 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:15:59.273145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 366/735] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:15:59 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:01.951608 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de570-f6dd-4b91-8209-b199abf72a55 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:01.952138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de570-f6dd-4b91-8209-b199abf72a55 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:01.952138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de570-f6dd-4b91-8209-b199abf72a55 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:01.953478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 370/736] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:01.958847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2608-2eae-4d84-95d8-73f1456eee91 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:01.959352 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2608-2eae-4d84-95d8-73f1456eee91 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:01.959637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2608-2eae-4d84-95d8-73f1456eee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:01.980051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-8d2d2608-2eae-4d84-95d8-73f1456eee91 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:01.981276 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-8d2d2608-2eae-4d84-95d8-73f1456eee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:01.989943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 367/737] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:16:02.326857 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de570-f6dd-4b91-8209-b199abf72a55 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:02.338510 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de570-f6dd-4b91-8209-b199abf72a55 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:02.342380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:02.343112 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:02.343513 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:02.343853 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:02.354692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:02.356193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70c02-8d59-47c0-b9bb-ec64fc0dbd81 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:02.372801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 371/738] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:04.936231 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e173-3517-4c18-b772-57bda54dda27 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:04.936754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e173-3517-4c18-b772-57bda54dda27 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:04.936754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e173-3517-4c18-b772-57bda54dda27 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:04.938008 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 368/739] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:04.943768 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb95fe-955b-4e26-b493-225b835a7a50 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:04.944182 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb95fe-955b-4e26-b493-225b835a7a50 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:04.944314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb95fe-955b-4e26-b493-225b835a7a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:04.963230 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-8efb95fe-955b-4e26-b493-225b835a7a50 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:04.964455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-8efb95fe-955b-4e26-b493-225b835a7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:04.972897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 372/740] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:05.313458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4e173-3517-4c18-b772-57bda54dda27 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:05.319068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=68 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:16:05.325418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4e173-3517-4c18-b772-57bda54dda27 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:05.329665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:05.330261 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:05.330535 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:05.330805 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:05.340383 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:05.341817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4859f3-1e31-4598-8da3-7375624cdc02 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:05.352111 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 369/741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:08.199345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337004b-517c-4243-850b-ad6d899e8251 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:08.199947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337004b-517c-4243-850b-ad6d899e8251 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:08.199947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337004b-517c-4243-850b-ad6d899e8251 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:08.201271 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 373/742] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:08.206750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d9b1-c320-4d90-a7ba-d10d40fb871c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:08.207198 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d9b1-c320-4d90-a7ba-d10d40fb871c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:08.207323 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d9b1-c320-4d90-a7ba-d10d40fb871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:08.227124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-1bc2d9b1-c320-4d90-a7ba-d10d40fb871c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:08.228347 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-1bc2d9b1-c320-4d90-a7ba-d10d40fb871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:08.236181 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 370/743] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:08.572409 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337004b-517c-4243-850b-ad6d899e8251 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:08.583194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337004b-517c-4243-850b-ad6d899e8251 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:08.586634 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:08.587223 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:08.587538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:08.587808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:08.596881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:08.598301 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf77ab-3399-4e60-bfe0-c85c58ae5ad4 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:08.607747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 374/744] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:13.422194 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f52-e0a9-46c6-81ad-5d0db573a350 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:13.422791 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f52-e0a9-46c6-81ad-5d0db573a350 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:13.422791 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f52-e0a9-46c6-81ad-5d0db573a350 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:13.424136 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 371/745] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:13.430433 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d442-4dee-4716-8e98-6db244e97ebc None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:13.431343 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d442-4dee-4716-8e98-6db244e97ebc None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:13.431343 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d442-4dee-4716-8e98-6db244e97ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:13.455815 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a795d442-4dee-4716-8e98-6db244e97ebc None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:13.457005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a795d442-4dee-4716-8e98-6db244e97ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:13.469196 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 375/746] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:13.859147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793f52-e0a9-46c6-81ad-5d0db573a350 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:13.871156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793f52-e0a9-46c6-81ad-5d0db573a350 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:13.874569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:13.875164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:13.875465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:13.875737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:13.899086 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:13.900667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6d158-f064-4c17-a410-645fe3f9e082 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:13.911919 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 372/747] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:17.063795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f457b4-dedc-4f32-8e16-f51dbebc49d1 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:17.064492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f457b4-dedc-4f32-8e16-f51dbebc49d1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:17.064492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f457b4-dedc-4f32-8e16-f51dbebc49d1 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:17.065773 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 376/748] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:17.071119 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b31d7-76d1-47ff-967b-bf80f50f7bc7 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:17.071596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b31d7-76d1-47ff-967b-bf80f50f7bc7 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:17.071862 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b31d7-76d1-47ff-967b-bf80f50f7bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:17.091365 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7a6b31d7-76d1-47ff-967b-bf80f50f7bc7 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:17.092586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7a6b31d7-76d1-47ff-967b-bf80f50f7bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:17.102478 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 373/749] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:17 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:17.438774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f457b4-dedc-4f32-8e16-f51dbebc49d1 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:17.444591 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=48 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:16:17.451019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f457b4-dedc-4f32-8e16-f51dbebc49d1 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:17.454649 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:17.455252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:17.455564 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:17.456413 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:17.466057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:17.467533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50c53b-76bd-48ea-8362-caccb8800c41 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:17.478719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 377/750] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:17 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:21.937410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733f37-b6be-4872-924b-4734df03e2be None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:21.937964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733f37-b6be-4872-924b-4734df03e2be None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:21.938064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733f37-b6be-4872-924b-4734df03e2be None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:21.940460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 374/751] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:21.946069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75364-8071-4f4d-9d4e-decb93ff9e51 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:21.946583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75364-8071-4f4d-9d4e-decb93ff9e51 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:21.946583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75364-8071-4f4d-9d4e-decb93ff9e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:21.965886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-83e75364-8071-4f4d-9d4e-decb93ff9e51 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:21.967098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-83e75364-8071-4f4d-9d4e-decb93ff9e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:21.975363 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 378/752] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:22.317647 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733f37-b6be-4872-924b-4734df03e2be None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:22.328695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733f37-b6be-4872-924b-4734df03e2be None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:22.332401 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:22.333007 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:22.333288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:22.333559 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:22.343271 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:22.345103 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f66e7-8539-4f92-a88e-4ec758c19d51 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:22.355804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 375/753] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:28.089445 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c2a5-8b23-4836-b9ad-75657899ea48 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:28.089899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c2a5-8b23-4836-b9ad-75657899ea48 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:28.089997 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c2a5-8b23-4836-b9ad-75657899ea48 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:28.091585 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 379/754] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:28.104060 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59cba-b0d8-473c-bca4-fa6c8a7a66cf None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:28.104892 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59cba-b0d8-473c-bca4-fa6c8a7a66cf None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:28.105408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59cba-b0d8-473c-bca4-fa6c8a7a66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:28.155527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-05d59cba-b0d8-473c-bca4-fa6c8a7a66cf None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:28.157091 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-05d59cba-b0d8-473c-bca4-fa6c8a7a66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:28.288511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 376/755] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:16:28 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:31.960903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=8 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:16:33.145532 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86c9d-26de-45b9-a15e-d567a2045062 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:33.146268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86c9d-26de-45b9-a15e-d567a2045062 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:33.146552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86c9d-26de-45b9-a15e-d567a2045062 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:33.148775 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 380/756] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:33.154251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d25ac-6a53-450f-b75c-2254d37fb104 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:33.155319 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d25ac-6a53-450f-b75c-2254d37fb104 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:33.155788 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d25ac-6a53-450f-b75c-2254d37fb104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:33.179150 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-993d25ac-6a53-450f-b75c-2254d37fb104 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:33.180407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-993d25ac-6a53-450f-b75c-2254d37fb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:33.190470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 377/757] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:16:33 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:34.769268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb108-f411-43e2-89db-e889bb918ce6 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:34.769794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb108-f411-43e2-89db-e889bb918ce6 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:34.769935 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb108-f411-43e2-89db-e889bb918ce6 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:34.771307 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 381/758] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:34.776579 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff05dc-d0ff-44be-a808-1ff8cfdae0ad None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:34.776984 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff05dc-d0ff-44be-a808-1ff8cfdae0ad None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:34.777132 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff05dc-d0ff-44be-a808-1ff8cfdae0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:34.797232 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-c7ff05dc-d0ff-44be-a808-1ff8cfdae0ad None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:34.798587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-c7ff05dc-d0ff-44be-a808-1ff8cfdae0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:34.807543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 378/759] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:16:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:16:39.089042 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74786-16bc-42c9-aafc-080d5af44780 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:39.089549 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74786-16bc-42c9-aafc-080d5af44780 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:39.089549 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74786-16bc-42c9-aafc-080d5af44780 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:39.090991 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 382/760] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:16:39.096497 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53ec7-928c-4b3f-8a27-cfb9094b782c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:39.096905 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53ec7-928c-4b3f-8a27-cfb9094b782c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:39.097050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53ec7-928c-4b3f-8a27-cfb9094b782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:39.104837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=69 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:16:39.118917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-22b53ec7-928c-4b3f-8a27-cfb9094b782c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:39.120135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-22b53ec7-928c-4b3f-8a27-cfb9094b782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:39.128715 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 379/761] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:39.484314 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e042e2-eef6-4928-8264-33ffd0c5407e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:39.484932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e042e2-eef6-4928-8264-33ffd0c5407e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:39.485546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e042e2-eef6-4928-8264-33ffd0c5407e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:39.489102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 383/762] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:16:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:39.498356 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd743d-4014-4ac9-a235-cde5e6b10e86 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:39.499014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd743d-4014-4ac9-a235-cde5e6b10e86 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:39.499771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd743d-4014-4ac9-a235-cde5e6b10e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:39.545722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-a7cd743d-4014-4ac9-a235-cde5e6b10e86 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:39.546765 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-a7cd743d-4014-4ac9-a235-cde5e6b10e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:39.625647 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 380/763] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:16:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:16:39.633502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e042e2-eef6-4928-8264-33ffd0c5407e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:39.648449 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e042e2-eef6-4928-8264-33ffd0c5407e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:39.653612 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:39.654239 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:39.654521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:39.654791 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:39.664792 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:39.666419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068857-af26-41b8-beb0-c5dbb63887cb service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:39.677623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 384/764] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:42.351464 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499bbb-fdf9-4786-adff-a22b821ab5dd None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:42.352017 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499bbb-fdf9-4786-adff-a22b821ab5dd None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:42.352242 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499bbb-fdf9-4786-adff-a22b821ab5dd None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:42.353673 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 381/765] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:42.359232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca3d-def4-401e-bb1a-5344163b105c None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:42.360079 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca3d-def4-401e-bb1a-5344163b105c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:42.361051 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca3d-def4-401e-bb1a-5344163b105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:42.381674 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-0d4fca3d-def4-401e-bb1a-5344163b105c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:42.383115 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-0d4fca3d-def4-401e-bb1a-5344163b105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:42.391360 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 385/766] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:42.734103 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a499bbb-fdf9-4786-adff-a22b821ab5dd None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:42.748342 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a499bbb-fdf9-4786-adff-a22b821ab5dd None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:42.754563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:42.756168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:42.756168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:42.756168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:42.800949 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:42.802629 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7ed0c-0efb-4d4e-9958-d32135fcee7e service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:42.813595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 382/767] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:45.611213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8857-2ac0-4df1-90ef-e407814e131c None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:45.612341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8857-2ac0-4df1-90ef-e407814e131c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:45.612628 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8857-2ac0-4df1-90ef-e407814e131c None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:45.614000 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 386/768] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:16:45.619829 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239ab8-fe31-4c5c-92be-43aeb8992b62 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:45.620637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239ab8-fe31-4c5c-92be-43aeb8992b62 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:45.621148 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239ab8-fe31-4c5c-92be-43aeb8992b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:45.644093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-09239ab8-fe31-4c5c-92be-43aeb8992b62 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:45.645587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-09239ab8-fe31-4c5c-92be-43aeb8992b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:45.654320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 383/769] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:46.006415 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2edb-6320-4b1b-bebf-e3e187decc99 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:46.006974 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2edb-6320-4b1b-bebf-e3e187decc99 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:46.007248 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2edb-6320-4b1b-bebf-e3e187decc99 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:46.008619 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 387/770] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:46.015462 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620b70-a759-4aca-8ee7-09d451886256 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:46.015945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620b70-a759-4aca-8ee7-09d451886256 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:46.016223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620b70-a759-4aca-8ee7-09d451886256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:46.047336 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-90620b70-a759-4aca-8ee7-09d451886256 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:46.049133 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-90620b70-a759-4aca-8ee7-09d451886256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:46.059668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 384/771] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:16:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:46.069126 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf2edb-6320-4b1b-bebf-e3e187decc99 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:46.086045 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf2edb-6320-4b1b-bebf-e3e187decc99 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:46.092549 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:46.093422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:46.093705 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:46.093975 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:46.103332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:46.106065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665bbc-3d34-46d4-8e3a-7a9cff2e967b service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:46.119363 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 388/772] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:48.753979 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea30-daf7-4ce9-8e21-1e18041d0349 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:48.754543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea30-daf7-4ce9-8e21-1e18041d0349 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:48.754543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea30-daf7-4ce9-8e21-1e18041d0349 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:48.761359 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 385/773] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:48.762411 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9266-cfaf-4749-ad0f-f64d2fe82db7 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:48.763265 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9266-cfaf-4749-ad0f-f64d2fe82db7 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:48.763770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9266-cfaf-4749-ad0f-f64d2fe82db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:48.799039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-0aaa9266-cfaf-4749-ad0f-f64d2fe82db7 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:48.800575 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-0aaa9266-cfaf-4749-ad0f-f64d2fe82db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:48.819799 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 389/774] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:16:49.222006 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371ea30-daf7-4ce9-8e21-1e18041d0349 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:49.246467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371ea30-daf7-4ce9-8e21-1e18041d0349 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:49.253322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:49.254135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:49.254535 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:49.254894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:49.268727 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:49.272978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76686cac-b30a-498b-8479-7c85748ad678 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:49.293332 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 386/775] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:49.769455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd354c-4eb8-4b93-b6af-a40d5c3480d4 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:49.770012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd354c-4eb8-4b93-b6af-a40d5c3480d4 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:49.770012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd354c-4eb8-4b93-b6af-a40d5c3480d4 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:49.771616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 390/776] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:49.777508 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0116c-9084-4533-a0ad-bc1eac948796 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:49.777971 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0116c-9084-4533-a0ad-bc1eac948796 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:49.778084 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0116c-9084-4533-a0ad-bc1eac948796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:49.799818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-4ea0116c-9084-4533-a0ad-bc1eac948796 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:49.800937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-4ea0116c-9084-4533-a0ad-bc1eac948796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:49.810436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 387/777] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:50.233698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bd35-7f0c-4bf1-8944-53b7b25e0b53 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:50.233698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bd35-7f0c-4bf1-8944-53b7b25e0b53 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:50.233698 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bd35-7f0c-4bf1-8944-53b7b25e0b53 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:50.234277 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 391/778] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 25 00:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:50.239376 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e551a4-b163-4489-9315-5e804510c17e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:50.239736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e551a4-b163-4489-9315-5e804510c17e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:50.240019 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e551a4-b163-4489-9315-5e804510c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:50.282898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-12e551a4-b163-4489-9315-5e804510c17e None None] MFA Rules not processed for user `dd5e7660d06144ebacc6118fd6192b82`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:50.284278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-12e551a4-b163-4489-9315-5e804510c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:50.369171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 388/779] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 25 00:16:50 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:50.377064 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bd35-7f0c-4bf1-8944-53b7b25e0b53 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:50.388534 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bd35-7f0c-4bf1-8944-53b7b25e0b53 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:50.392893 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5e7660d06144ebacc6118fd6192b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:50.393603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:50.394149 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:50.394424 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:50.404305 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:50.405882 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1cf8e-a73f-4b85-9c7c-e91097049a3b service cinder] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:50.416436 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 392/780] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:51.872314 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018a9d-b989-453b-8f7c-ddc73c022fae None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:51.872914 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018a9d-b989-453b-8f7c-ddc73c022fae None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:51.872914 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018a9d-b989-453b-8f7c-ddc73c022fae None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:51.874273 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 389/781] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:51.881262 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb86e-8f85-4839-a1ab-5d98381ef94d None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:51.881817 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb86e-8f85-4839-a1ab-5d98381ef94d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:51.882087 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb86e-8f85-4839-a1ab-5d98381ef94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:51.903795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-5decb86e-8f85-4839-a1ab-5d98381ef94d None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:51.905017 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-5decb86e-8f85-4839-a1ab-5d98381ef94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:51.913758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 393/782] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:52.267932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06018a9d-b989-453b-8f7c-ddc73c022fae None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:52.282780 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06018a9d-b989-453b-8f7c-ddc73c022fae None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:52.288330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:52.288967 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:52.289250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:52.289525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:52.299018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:52.300716 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb21ec-875c-49e1-97ae-6c3634f78804 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:52.305152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:16:52.312350 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 390/783] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:54.852620 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9f84-9413-4ba8-a553-b0e30f3c53c3 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:54.853172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9f84-9413-4ba8-a553-b0e30f3c53c3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:54.853172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9f84-9413-4ba8-a553-b0e30f3c53c3 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:54.854479 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 394/784] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:54.859970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522206e-e276-4c9b-bdbd-02f785cdaee6 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:54.860440 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522206e-e276-4c9b-bdbd-02f785cdaee6 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:54.860901 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522206e-e276-4c9b-bdbd-02f785cdaee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:54.881331 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d522206e-e276-4c9b-bdbd-02f785cdaee6 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:54.882525 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d522206e-e276-4c9b-bdbd-02f785cdaee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:54.890484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 391/785] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:55.242837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b9f84-9413-4ba8-a553-b0e30f3c53c3 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:55.259022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b9f84-9413-4ba8-a553-b0e30f3c53c3 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:55.264342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:55.265081 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:55.265460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:55.265831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:55.275703 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:55.277419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39e149-c769-428a-aa58-a0c3b57de0ea service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:55.295763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 395/786] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:16:57.827954 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816d009-be67-45f7-ae52-3a8c13d4219a None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:57.828553 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816d009-be67-45f7-ae52-3a8c13d4219a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:57.828553 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816d009-be67-45f7-ae52-3a8c13d4219a None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:57.829908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 392/787] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:16:57.835446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92009-6af7-4239-9c45-20cd634512c6 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:57.835909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92009-6af7-4239-9c45-20cd634512c6 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:57.836020 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92009-6af7-4239-9c45-20cd634512c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:57.856680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-83a92009-6af7-4239-9c45-20cd634512c6 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:16:57.857855 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-83a92009-6af7-4239-9c45-20cd634512c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:16:57.866417 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 396/788] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:16:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:16:58.209355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816d009-be67-45f7-ae52-3a8c13d4219a None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:16:58.224082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816d009-be67-45f7-ae52-3a8c13d4219a None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:16:58.229057 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:16:58.229728 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:16:58.230099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:16:58.230439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:16:58.239490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:16:58.240973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d21d-3842-444d-bdca-1d6ee2abd10d service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:16:58.251770 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 393/789] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:16:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:00.851915 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73921362-9253-49d5-89da-b3d19cd581d2 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:00.852562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73921362-9253-49d5-89da-b3d19cd581d2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:00.852562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73921362-9253-49d5-89da-b3d19cd581d2 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:00.854261 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 397/790] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:00.861763 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359d5e-9ada-48eb-96c2-8a4e6422155d None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:00.862932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359d5e-9ada-48eb-96c2-8a4e6422155d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:00.862932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359d5e-9ada-48eb-96c2-8a4e6422155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:00.885164 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-b3359d5e-9ada-48eb-96c2-8a4e6422155d None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:00.886660 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-b3359d5e-9ada-48eb-96c2-8a4e6422155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:00.896793 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 394/791] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:01.360606 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73921362-9253-49d5-89da-b3d19cd581d2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:01.374586 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73921362-9253-49d5-89da-b3d19cd581d2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:01.379870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:01.380503 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:01.380786 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:01.381065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:01.394573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:01.396482 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fa175-9829-4e40-8470-d1265881d7bd service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:01.409373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 398/792] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:17:04.808804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274a23-06b0-4743-aa50-43eb041e8036 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:04.809470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274a23-06b0-4743-aa50-43eb041e8036 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:04.809470 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274a23-06b0-4743-aa50-43eb041e8036 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:04.810766 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 395/793] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:04.817050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb55ef-2468-4b63-a0dd-e922bdff7841 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:04.817604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb55ef-2468-4b63-a0dd-e922bdff7841 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:04.817604 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb55ef-2468-4b63-a0dd-e922bdff7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:04.825230 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=43 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:17:04.839694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-97fb55ef-2468-4b63-a0dd-e922bdff7841 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:04.840899 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-97fb55ef-2468-4b63-a0dd-e922bdff7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:04.849669 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 399/794] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:05.204964 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274a23-06b0-4743-aa50-43eb041e8036 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:05.219639 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274a23-06b0-4743-aa50-43eb041e8036 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:05.225018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:05.225661 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:05.225940 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:05.226210 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:05.235804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:05.237467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31168732-0cac-42a3-8788-9681a6d07840 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:05.247545 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 396/795] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:06.846480 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a177f-8fff-4e68-8158-45ebe0cfc445 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:06.847091 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a177f-8fff-4e68-8158-45ebe0cfc445 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:06.847091 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a177f-8fff-4e68-8158-45ebe0cfc445 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:06.848548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 400/796] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:06.854182 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d778-c150-43dd-a602-6ea2c8a619d8 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:06.854653 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d778-c150-43dd-a602-6ea2c8a619d8 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:06.854756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d778-c150-43dd-a602-6ea2c8a619d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:06.876937 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-f838d778-c150-43dd-a602-6ea2c8a619d8 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:06.878182 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f838d778-c150-43dd-a602-6ea2c8a619d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:06.886318 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 397/797] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:07.258595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da435-2e66-4e58-a7f8-66664072d843 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:07.258911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da435-2e66-4e58-a7f8-66664072d843 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:07.259206 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da435-2e66-4e58-a7f8-66664072d843 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:07.260857 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 401/798] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 25 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:07.267680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebde66-0b48-4b08-8924-68afc331cdc4 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:07.268415 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebde66-0b48-4b08-8924-68afc331cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:07.268693 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebde66-0b48-4b08-8924-68afc331cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:07.313341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-eeebde66-0b48-4b08-8924-68afc331cdc4 None None] MFA Rules not processed for user `81a90ffe3e5d438d8aa888e20cd40bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:07.314658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-eeebde66-0b48-4b08-8924-68afc331cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:07.387760 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 398/799] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 25 00:17:07 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:07.396062 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da435-2e66-4e58-a7f8-66664072d843 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:07.408016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da435-2e66-4e58-a7f8-66664072d843 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:07.411657 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a90ffe3e5d438d8aa888e20cd40bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:07.412257 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:07.412538 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:07.412812 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:07.422570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:07.424084 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca6bd-60fa-498e-93e7-79868055d840 service glance] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:07.434471 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 402/800] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:07.731048 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209d8a-5550-4133-84fb-d21916551570 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:07.731389 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209d8a-5550-4133-84fb-d21916551570 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:07.731637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209d8a-5550-4133-84fb-d21916551570 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:07.732973 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 399/801] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:07.738701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3c9e2-750c-4b86-b710-196caea4e862 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:07.739038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3c9e2-750c-4b86-b710-196caea4e862 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:07.739461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3c9e2-750c-4b86-b710-196caea4e862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:07.762385 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a5d3c9e2-750c-4b86-b710-196caea4e862 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:07.763615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a5d3c9e2-750c-4b86-b710-196caea4e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:07.772755 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 403/802] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:08.128787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209d8a-5550-4133-84fb-d21916551570 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:08.146455 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209d8a-5550-4133-84fb-d21916551570 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:08.152031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:08.152949 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:08.153241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:08.153513 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:08.168519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:08.170173 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756193ca-e6ff-4860-a9b6-efb8164c0086 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:08.188297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 400/803] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:10.891352 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc5fe-844d-4331-a34c-b71235db49fb None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:10.892061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc5fe-844d-4331-a34c-b71235db49fb None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:10.892061 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc5fe-844d-4331-a34c-b71235db49fb None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:10.893299 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 404/804] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:10.898929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054245-2958-420e-9450-dab03e34a269 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:10.899461 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054245-2958-420e-9450-dab03e34a269 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:10.899570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054245-2958-420e-9450-dab03e34a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:10.922050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-8f054245-2958-420e-9450-dab03e34a269 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:10.923277 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-8f054245-2958-420e-9450-dab03e34a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:10.935610 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 401/805] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:11.280219 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc5fe-844d-4331-a34c-b71235db49fb None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:11.294701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc5fe-844d-4331-a34c-b71235db49fb None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:11.300656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:11.301484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:11.301943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:11.302375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:11.318746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:11.320704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c33bc-de72-4c4e-8ba6-2b65e76f9cbd service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:11.331554 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 405/806] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:13.981323 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd0e5-9faf-4f7e-a451-47682f5c34e3 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:13.982039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd0e5-9faf-4f7e-a451-47682f5c34e3 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:13.982039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd0e5-9faf-4f7e-a451-47682f5c34e3 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:13.983206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 402/807] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:13.990630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f44e8-96b4-4b3e-b1e4-a5183e92b955 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:13.991199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f44e8-96b4-4b3e-b1e4-a5183e92b955 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:13.991624 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f44e8-96b4-4b3e-b1e4-a5183e92b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:14.016661 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-f29f44e8-96b4-4b3e-b1e4-a5183e92b955 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:14.018416 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-f29f44e8-96b4-4b3e-b1e4-a5183e92b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:14.027801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 406/808] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:17:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:14.467388 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd0e5-9faf-4f7e-a451-47682f5c34e3 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:14.485355 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd0e5-9faf-4f7e-a451-47682f5c34e3 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:14.491941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:14.492562 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:14.492838 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:14.493106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:14.503221 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:14.505983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702daace-c49a-4629-a490-2cf6df3f080c service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:14.520015 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 403/809] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:23.234272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d951b-0ea6-4c62-9e7d-daeac1bb1928 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:23.235050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d951b-0ea6-4c62-9e7d-daeac1bb1928 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:23.235050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d951b-0ea6-4c62-9e7d-daeac1bb1928 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:23.236179 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 407/810] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 25 00:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:23.241640 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747eda6-7575-428e-a539-f2a7f309317e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:23.242123 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747eda6-7575-428e-a539-f2a7f309317e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:23.242227 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747eda6-7575-428e-a539-f2a7f309317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:23.250346 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=71 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:17:23.263116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-5747eda6-7575-428e-a539-f2a7f309317e None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:23.264431 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-5747eda6-7575-428e-a539-f2a7f309317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:23.273518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 404/811] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 25 00:17:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:23.287509 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053aa3e-71a6-49b2-81fb-3e16faf55219 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:23.287795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053aa3e-71a6-49b2-81fb-3e16faf55219 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:23.288069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053aa3e-71a6-49b2-81fb-3e16faf55219 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:23.289396 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 408/812] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 25 00:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:23.294085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89707-4b71-4561-a43b-1ad160d7a49c None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:23.294387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89707-4b71-4561-a43b-1ad160d7a49c None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:23.294657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89707-4b71-4561-a43b-1ad160d7a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:23.315883 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-e9a89707-4b71-4561-a43b-1ad160d7a49c None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:23.317094 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-e9a89707-4b71-4561-a43b-1ad160d7a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:23.325776 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 405/813] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 25 00:17:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:17:24.010071 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=20 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:17:26.269137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ca88-6075-4991-b3e9-0861fecb3934 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:26.269854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ca88-6075-4991-b3e9-0861fecb3934 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:26.269854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ca88-6075-4991-b3e9-0861fecb3934 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:26.271005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 409/814] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:26.276520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e3fb-9f8a-4a3e-b5d2-63094de92868 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:26.277010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e3fb-9f8a-4a3e-b5d2-63094de92868 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:26.277113 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e3fb-9f8a-4a3e-b5d2-63094de92868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:26.296730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d651e3fb-9f8a-4a3e-b5d2-63094de92868 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:26.297838 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d651e3fb-9f8a-4a3e-b5d2-63094de92868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:26.305734 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 406/815] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:26.652823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469ca88-6075-4991-b3e9-0861fecb3934 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:26.668109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469ca88-6075-4991-b3e9-0861fecb3934 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:26.673652 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:26.674246 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:26.674520 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:26.674785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:26.683156 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:26.684757 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825c41c-857a-4c2d-a301-7f6752fcf626 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:26.694037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 410/816] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:28.426482 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa15494-cd3f-4102-a178-9767873d90c5 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:28.427050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa15494-cd3f-4102-a178-9767873d90c5 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:28.427050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa15494-cd3f-4102-a178-9767873d90c5 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:28.428417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 407/817] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:28.433564 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b5e6-5179-4504-a0b0-3b5300c0c0e1 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:28.434100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b5e6-5179-4504-a0b0-3b5300c0c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:28.434100 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b5e6-5179-4504-a0b0-3b5300c0c0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:28.458746 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2260b5e6-5179-4504-a0b0-3b5300c0c0e1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:28.460028 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2260b5e6-5179-4504-a0b0-3b5300c0c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:28.468947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 411/818] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:28.686295 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa15494-cd3f-4102-a178-9767873d90c5 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:28.699908 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa15494-cd3f-4102-a178-9767873d90c5 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:28.705707 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:28.706311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:28.706588 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:28.706866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:28.715557 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:28.717925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62df3f-8067-4c74-bf5e-fb16165ceecb service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:28.727675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 408/819] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:30.464486 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8230d-db0e-4a9c-8fe2-efd4683700b2 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:30.465038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8230d-db0e-4a9c-8fe2-efd4683700b2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:30.465038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8230d-db0e-4a9c-8fe2-efd4683700b2 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:30.466365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 412/820] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:30.472515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12ba1-742c-4b98-aa33-1644312ff95e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:30.472997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12ba1-742c-4b98-aa33-1644312ff95e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:30.473187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12ba1-742c-4b98-aa33-1644312ff95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:30.493156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-8df12ba1-742c-4b98-aa33-1644312ff95e None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:30.494340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-8df12ba1-742c-4b98-aa33-1644312ff95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:30.502586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 409/821] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:30.665015 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8230d-db0e-4a9c-8fe2-efd4683700b2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:30.678882 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8230d-db0e-4a9c-8fe2-efd4683700b2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:30.683748 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:30.684340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:30.684614 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:30.684881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:30.693925 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:30.695507 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0500404-a1cb-452e-be2a-2e158cb44413 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:30.705440 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 413/822] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:32.410017 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707eca7-cb7e-4a7c-8616-0846ac7c5d24 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:32.410587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707eca7-cb7e-4a7c-8616-0846ac7c5d24 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:32.410587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707eca7-cb7e-4a7c-8616-0846ac7c5d24 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:32.411968 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 410/823] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:32.417010 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c63ce-261e-4fbb-abf2-c62d5860625d None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:32.417465 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c63ce-261e-4fbb-abf2-c62d5860625d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:32.417657 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c63ce-261e-4fbb-abf2-c62d5860625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:32.438348 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-885c63ce-261e-4fbb-abf2-c62d5860625d None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:32.439612 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-885c63ce-261e-4fbb-abf2-c62d5860625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:32.447694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 414/824] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:17:32.608725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707eca7-cb7e-4a7c-8616-0846ac7c5d24 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:32.623235 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707eca7-cb7e-4a7c-8616-0846ac7c5d24 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:32.628202 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:32.628798 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:32.629068 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:32.629335 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:32.638124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:32.640017 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e4bb-919b-419e-9c73-85e5c8d518c9 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:32.650194 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 411/825] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:34.355272 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c739-efb7-4c99-869e-e1ba4de09ef1 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:34.355847 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c739-efb7-4c99-869e-e1ba4de09ef1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:34.355847 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c739-efb7-4c99-869e-e1ba4de09ef1 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:34.357198 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 415/826] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:34.363135 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d302-c751-463d-8eef-959055cfdcce None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:34.363657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d302-c751-463d-8eef-959055cfdcce None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:34.363769 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d302-c751-463d-8eef-959055cfdcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:34.384885 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-9ce1d302-c751-463d-8eef-959055cfdcce None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:34.386092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-9ce1d302-c751-463d-8eef-959055cfdcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:34.394069 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 412/827] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:34.553602 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c739-efb7-4c99-869e-e1ba4de09ef1 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:34.569727 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c739-efb7-4c99-869e-e1ba4de09ef1 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:34.574906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:34.575774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:34.576046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:34.576373 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:34.584956 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:34.586584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4a90-f143-4ddf-9dc0-71cc0bbb8f2a service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:34.596801 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 416/828] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:36.258186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f13e-b26f-461d-b936-a931a1bfbb07 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:36.258778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f13e-b26f-461d-b936-a931a1bfbb07 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:36.258778 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f13e-b26f-461d-b936-a931a1bfbb07 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:36.260170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 413/829] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:17:36.266617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a144-8b76-467b-be8d-60099974e346 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:36.267186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a144-8b76-467b-be8d-60099974e346 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:36.267186 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a144-8b76-467b-be8d-60099974e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:36.287732 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2391a144-8b76-467b-be8d-60099974e346 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:36.288964 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2391a144-8b76-467b-be8d-60099974e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:36.297031 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 417/830] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:36.460213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07f13e-b26f-461d-b936-a931a1bfbb07 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:36.474751 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07f13e-b26f-461d-b936-a931a1bfbb07 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:36.479762 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:36.480368 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:36.480644 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:36.480910 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:36.489524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:36.491093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b847fc3-9937-4186-b038-d4ca8776977d service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:36.500540 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 414/831] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:38.133628 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced607e-7692-43f6-854b-a8b8c54fc140 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:38.134184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced607e-7692-43f6-854b-a8b8c54fc140 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:38.134184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced607e-7692-43f6-854b-a8b8c54fc140 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:38.135673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 418/832] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:38.140866 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6676-020c-4f67-9984-05b7ee3ee685 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:38.141317 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6676-020c-4f67-9984-05b7ee3ee685 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:38.141431 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6676-020c-4f67-9984-05b7ee3ee685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:38.161515 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-847a6676-020c-4f67-9984-05b7ee3ee685 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:38.162713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-847a6676-020c-4f67-9984-05b7ee3ee685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:38.171040 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 415/833] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:38.332326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced607e-7692-43f6-854b-a8b8c54fc140 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:38.346879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced607e-7692-43f6-854b-a8b8c54fc140 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:38.351970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:38.352576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:38.352854 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:38.353122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:38.362835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:38.364521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5124299-8176-4f66-8f17-8da2d0462ce9 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:38.375626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 419/834] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:40.005621 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73182d-e35c-475f-9251-7db795f6f5cc None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:40.006209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73182d-e35c-475f-9251-7db795f6f5cc None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:40.006209 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73182d-e35c-475f-9251-7db795f6f5cc None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:40.007565 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 416/835] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:40.012476 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96dd9b-a2d8-4df2-9739-353d9fecc0a8 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:40.012883 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96dd9b-a2d8-4df2-9739-353d9fecc0a8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:40.013022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96dd9b-a2d8-4df2-9739-353d9fecc0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:40.033191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-2e96dd9b-a2d8-4df2-9739-353d9fecc0a8 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:40.034401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-2e96dd9b-a2d8-4df2-9739-353d9fecc0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:40.042285 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 420/836] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:40.200114 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73182d-e35c-475f-9251-7db795f6f5cc None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:40.214963 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73182d-e35c-475f-9251-7db795f6f5cc None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:40.221303 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:40.221928 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:40.222203 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:40.222479 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:40.231392 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:40.233108 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7ee32-a3c8-4e03-8be1-fff025057416 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:40.243005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 417/837] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:41.914472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0912d6-50f2-432b-a77e-00f0485b4098 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:41.915057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0912d6-50f2-432b-a77e-00f0485b4098 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:41.915057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0912d6-50f2-432b-a77e-00f0485b4098 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:41.916413 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 421/838] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:41.922117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d1ef-98eb-4c3d-9eed-85b4e373dc33 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:41.922577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d1ef-98eb-4c3d-9eed-85b4e373dc33 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:41.922684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d1ef-98eb-4c3d-9eed-85b4e373dc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:41.942434 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d135d1ef-98eb-4c3d-9eed-85b4e373dc33 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:41.943884 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d135d1ef-98eb-4c3d-9eed-85b4e373dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:41.951960 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 418/839] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:17:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:17:42.110263 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0912d6-50f2-432b-a77e-00f0485b4098 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:42.123664 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0912d6-50f2-432b-a77e-00f0485b4098 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:42.128613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:42.129207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:42.129483 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:42.129753 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:42.138341 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:42.140369 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cf22-d8fa-429d-b7bf-12ae9eec45ad service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:42.150249 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 422/840] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:44.494390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cc37-d34e-4836-8791-97edc0350f70 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:44.494921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cc37-d34e-4836-8791-97edc0350f70 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:44.494921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cc37-d34e-4836-8791-97edc0350f70 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:44.496320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 419/841] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:44.502362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b087c6-efb4-4881-8147-a57595c3671b None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:44.502830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b087c6-efb4-4881-8147-a57595c3671b None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:44.502929 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b087c6-efb4-4881-8147-a57595c3671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:44.523024 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-e7b087c6-efb4-4881-8147-a57595c3671b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:44.524242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-e7b087c6-efb4-4881-8147-a57595c3671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:44.532600 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 423/842] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:44.884027 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cc37-d34e-4836-8791-97edc0350f70 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:44.895763 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cc37-d34e-4836-8791-97edc0350f70 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:44.899147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:44.899768 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:44.900043 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:44.900308 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:44.909611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:44.911025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5658fa0-ea5d-488a-a5ef-a0fc7887d56c service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:44.920204 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 420/843] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:47.543806 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861cfb-97d2-4862-bc49-b6c7216a8bd8 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:47.544484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861cfb-97d2-4862-bc49-b6c7216a8bd8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:47.544484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861cfb-97d2-4862-bc49-b6c7216a8bd8 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:47.545740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 424/844] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:17:47.551197 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071af58b-85b9-4f74-b863-c8ceaeb7ab77 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:47.551890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071af58b-85b9-4f74-b863-c8ceaeb7ab77 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:47.551890 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071af58b-85b9-4f74-b863-c8ceaeb7ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:47.572140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-071af58b-85b9-4f74-b863-c8ceaeb7ab77 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:47.573381 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-071af58b-85b9-4f74-b863-c8ceaeb7ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:47.582127 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 421/845] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:47.934808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861cfb-97d2-4862-bc49-b6c7216a8bd8 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:47.947046 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861cfb-97d2-4862-bc49-b6c7216a8bd8 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:47.951321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:47.952008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:47.952315 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:47.952610 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:47.963368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:47.964895 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93d9d9-613b-4ddd-b36c-576f57b187ff service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:47.975634 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 425/846] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:50.755637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c71f-8250-4abf-a33e-390162cb43fc None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:50.756224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c71f-8250-4abf-a33e-390162cb43fc None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:50.756224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c71f-8250-4abf-a33e-390162cb43fc None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:50.757506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 422/847] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:50.762969 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647802-59e1-40b2-a8dd-65e3a6367820 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:50.763488 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647802-59e1-40b2-a8dd-65e3a6367820 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:50.763608 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647802-59e1-40b2-a8dd-65e3a6367820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:50.783083 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-9a647802-59e1-40b2-a8dd-65e3a6367820 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:50.784327 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-9a647802-59e1-40b2-a8dd-65e3a6367820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:50.792160 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 426/848] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:51.136449 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c71f-8250-4abf-a33e-390162cb43fc None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:51.147228 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c71f-8250-4abf-a33e-390162cb43fc None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:51.150788 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:51.151387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:51.151697 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:51.151965 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:51.162308 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:51.163806 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f3e73-5467-4757-9043-933159d4cd62 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:51.175102 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 423/849] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:53.786556 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2fec8-c57d-426c-8ef8-a652e6a9909d None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:53.787127 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2fec8-c57d-426c-8ef8-a652e6a9909d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:53.787127 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2fec8-c57d-426c-8ef8-a652e6a9909d None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:53.788474 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 427/850] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:17:53.793851 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ad5a-4176-47c8-acad-2ffcb7f0548a None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:53.794402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ad5a-4176-47c8-acad-2ffcb7f0548a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:53.794529 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ad5a-4176-47c8-acad-2ffcb7f0548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:53.803961 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=60 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:17:53.817748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-1c24ad5a-4176-47c8-acad-2ffcb7f0548a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:53.818941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-1c24ad5a-4176-47c8-acad-2ffcb7f0548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:53.827178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 424/851] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:54.184158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2fec8-c57d-426c-8ef8-a652e6a9909d None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:54.191150 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=55 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:17:54.198598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2fec8-c57d-426c-8ef8-a652e6a9909d None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:54.203612 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:54.204328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:54.204692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:54.205050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:54.215568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:54.217430 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3eae-fec5-4d33-9a21-ed4169fd2c20 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:54.227002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 428/852] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:56.736026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d62-246b-4be9-89d1-d7ba561572fd None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:56.737769 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d62-246b-4be9-89d1-d7ba561572fd None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:56.737769 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d62-246b-4be9-89d1-d7ba561572fd None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:56.737956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 425/853] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:56.743213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f0235-6ef1-413b-aae6-97030328ca67 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:56.743635 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f0235-6ef1-413b-aae6-97030328ca67 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:56.743785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f0235-6ef1-413b-aae6-97030328ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:56.763436 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d59f0235-6ef1-413b-aae6-97030328ca67 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:56.764574 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d59f0235-6ef1-413b-aae6-97030328ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:56.772508 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 429/854] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:17:57.106225 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53d62-246b-4be9-89d1-d7ba561572fd None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:17:57.117116 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53d62-246b-4be9-89d1-d7ba561572fd None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:17:57.120520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:17:57.121107 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:57.121381 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:57.121650 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:57.131310 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:17:57.132762 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42ef4-90d7-42b9-9956-78063fbfc538 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:17:57.142930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 426/855] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:17:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:17:59.673435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075d4fb-94ed-4ff5-a75f-63944ea895ad None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:59.673963 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075d4fb-94ed-4ff5-a75f-63944ea895ad None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:59.673963 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075d4fb-94ed-4ff5-a75f-63944ea895ad None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:59.675247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 430/856] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:17:59.680611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d412c4-5bfd-4af9-bd30-9a15a7fc7c53 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:17:59.681064 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d412c4-5bfd-4af9-bd30-9a15a7fc7c53 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:17:59.681171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d412c4-5bfd-4af9-bd30-9a15a7fc7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:17:59.701280 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-f2d412c4-5bfd-4af9-bd30-9a15a7fc7c53 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:17:59.702503 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f2d412c4-5bfd-4af9-bd30-9a15a7fc7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:17:59.710326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 427/857] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:17:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:00.046158 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075d4fb-94ed-4ff5-a75f-63944ea895ad None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:00.056874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075d4fb-94ed-4ff5-a75f-63944ea895ad None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:00.061034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:00.061607 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:00.061888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:00.062159 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:00.070947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:00.072402 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b887b45-a039-4325-9210-a04b48cf92ba service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:00.081973 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 431/858] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:02.607039 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b28a-a941-4159-b3db-77e8fa2176fb None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:02.607596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b28a-a941-4159-b3db-77e8fa2176fb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:02.607596 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b28a-a941-4159-b3db-77e8fa2176fb None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:02.609003 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 428/859] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:18:02.615605 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ea2a-cfc8-4849-84c4-5b47cde27f49 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:02.616091 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ea2a-cfc8-4849-84c4-5b47cde27f49 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:02.616192 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ea2a-cfc8-4849-84c4-5b47cde27f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:02.635942 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-b6b7ea2a-cfc8-4849-84c4-5b47cde27f49 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:02.637136 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-b6b7ea2a-cfc8-4849-84c4-5b47cde27f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:02.645717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 432/860] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:18:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:02.989534 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b28a-a941-4159-b3db-77e8fa2176fb None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:03.000960 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b28a-a941-4159-b3db-77e8fa2176fb None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:03.004467 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:03.005088 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:03.005341 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:03.005617 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:03.015051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:03.016523 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f317ca5-9a1e-4c03-83af-3bc5bf09dd0f service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:03.025753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 429/861] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:05.490420 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0958a-c1bb-466c-b8c6-1fe831ce50b3 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:05.490961 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0958a-c1bb-466c-b8c6-1fe831ce50b3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:05.491052 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0958a-c1bb-466c-b8c6-1fe831ce50b3 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:05.492686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 433/862] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:18:05.500722 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8b63d-5b78-479e-a7fe-e985924561b2 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:05.501223 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8b63d-5b78-479e-a7fe-e985924561b2 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:05.501327 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8b63d-5b78-479e-a7fe-e985924561b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:05.521627 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d6f8b63d-5b78-479e-a7fe-e985924561b2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:05.522818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d6f8b63d-5b78-479e-a7fe-e985924561b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:05.531520 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 430/863] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:18:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:05.867063 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0958a-c1bb-466c-b8c6-1fe831ce50b3 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:05.877916 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0958a-c1bb-466c-b8c6-1fe831ce50b3 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:05.881453 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:05.882048 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:05.882328 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:05.882603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:05.892008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:05.893437 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203c1df-fd61-4afa-bffa-e60341c1a70d service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:05.902681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 434/864] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:08.352569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287a08-6431-4cae-81b9-c6d0afa87bb7 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:08.353140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287a08-6431-4cae-81b9-c6d0afa87bb7 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:08.353140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287a08-6431-4cae-81b9-c6d0afa87bb7 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:08.354472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 431/865] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:08.360589 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7223-df83-4168-8f18-0c371366024b None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:08.361039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7223-df83-4168-8f18-0c371366024b None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:08.361238 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7223-df83-4168-8f18-0c371366024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:08.381049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-c2eb7223-df83-4168-8f18-0c371366024b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:08.382230 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-c2eb7223-df83-4168-8f18-0c371366024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:08.390452 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 435/866] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:18:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:08.731402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287a08-6431-4cae-81b9-c6d0afa87bb7 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:08.742023 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287a08-6431-4cae-81b9-c6d0afa87bb7 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:08.745468 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:08.746058 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:08.746335 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:08.746650 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:08.755694 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:08.757152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4377e44-e843-45b9-8e28-cfa445fdbde8 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:08.767716 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 432/867] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:11.263242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa9a1-9c64-42a6-bf69-8d4a07e6e27f None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:11.263242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa9a1-9c64-42a6-bf69-8d4a07e6e27f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:11.263943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa9a1-9c64-42a6-bf69-8d4a07e6e27f None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:11.264921 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 436/868] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:11.270550 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200e2-f5c3-4df5-b994-dbe1967241a3 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:11.270934 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200e2-f5c3-4df5-b994-dbe1967241a3 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:11.271106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200e2-f5c3-4df5-b994-dbe1967241a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:11.291367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-5a8200e2-f5c3-4df5-b994-dbe1967241a3 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:11.292616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-5a8200e2-f5c3-4df5-b994-dbe1967241a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:11.300947 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 433/869] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:18:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:11.645503 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa9a1-9c64-42a6-bf69-8d4a07e6e27f None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:11.657142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa9a1-9c64-42a6-bf69-8d4a07e6e27f None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:11.660552 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:11.661142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:11.661419 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:11.661686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:11.671371 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:11.672821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06c38a-9729-4a2d-ba9e-bedc58268a02 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:11.682178 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 437/870] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:21.286423 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=29 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:18:21.678172 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=32 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:18:36.639694 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e391-7f91-4d8d-a8fa-ce34d5e287e6 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:36.640234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e391-7f91-4d8d-a8fa-ce34d5e287e6 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:36.640234 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e391-7f91-4d8d-a8fa-ce34d5e287e6 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:36.641473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 434/871] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:36.646778 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801bbf4-ca6f-4838-9adc-d9e07282be35 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:36.647200 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801bbf4-ca6f-4838-9adc-d9e07282be35 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:36.647330 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801bbf4-ca6f-4838-9adc-d9e07282be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:36.666751 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-b801bbf4-ca6f-4838-9adc-d9e07282be35 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:36.668196 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-b801bbf4-ca6f-4838-9adc-d9e07282be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:36.676074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 438/872] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:37.047873 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0ac4-8fd4-4866-bf60-0934ce89b5fb None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:37.048158 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0ac4-8fd4-4866-bf60-0934ce89b5fb None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:37.048435 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0ac4-8fd4-4866-bf60-0934ce89b5fb None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:37.049789 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 435/873] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 25 00:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:37.055055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975f8e-cdb2-4a9c-8e09-ebe6c83cb16d None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:37.055339 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975f8e-cdb2-4a9c-8e09-ebe6c83cb16d None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:37.057411 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975f8e-cdb2-4a9c-8e09-ebe6c83cb16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:37.080111 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-5c975f8e-cdb2-4a9c-8e09-ebe6c83cb16d None None] MFA Rules not processed for user `81a90ffe3e5d438d8aa888e20cd40bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:37.081284 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-5c975f8e-cdb2-4a9c-8e09-ebe6c83cb16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:37.087598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 439/874] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 25 00:18:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:37.095601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0ac4-8fd4-4866-bf60-0934ce89b5fb None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:37.106067 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0ac4-8fd4-4866-bf60-0934ce89b5fb None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:37.109569 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a90ffe3e5d438d8aa888e20cd40bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:37.110161 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:37.110439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:37.110711 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:37.119568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:37.121527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8a3d-b73c-45e1-9e5b-52b964050fb8 service glance] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:37.130788 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 436/875] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:39.721560 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3687-0110-4ca8-98b5-608fa2418079 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:39.722170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3687-0110-4ca8-98b5-608fa2418079 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:39.722170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3687-0110-4ca8-98b5-608fa2418079 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:39.723477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 440/876] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:39.728825 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c430-938c-4e7d-b119-fd1ed864dda1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:39.729228 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c430-938c-4e7d-b119-fd1ed864dda1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:39.729469 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c430-938c-4e7d-b119-fd1ed864dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:39.748695 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-5279c430-938c-4e7d-b119-fd1ed864dda1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:39.749888 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-5279c430-938c-4e7d-b119-fd1ed864dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:39.758092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 437/877] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:40.092715 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce3687-0110-4ca8-98b5-608fa2418079 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:40.104994 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce3687-0110-4ca8-98b5-608fa2418079 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:40.109416 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:40.110009 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:40.110289 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:40.110562 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:40.111199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:40.112337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:18:40.112337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:18:40.112337 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:18:40.113477 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb98d5a-180d-4cc2-b8b1-20514a9b141b admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:40.131771 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 441/878] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 25 00:18:40 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:18:42.558972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49708e-b209-4b2e-a333-8f9ca1e1a548 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:42.559533 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49708e-b209-4b2e-a333-8f9ca1e1a548 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:42.559533 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49708e-b209-4b2e-a333-8f9ca1e1a548 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:42.560868 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 438/879] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:42.566168 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558bd1d-17f5-4778-8f8f-c18edca2b958 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:42.566613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558bd1d-17f5-4778-8f8f-c18edca2b958 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:42.566747 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558bd1d-17f5-4778-8f8f-c18edca2b958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:42.586714 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-f558bd1d-17f5-4778-8f8f-c18edca2b958 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:42.587925 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-f558bd1d-17f5-4778-8f8f-c18edca2b958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:42.596999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 442/880] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:42.944030 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49708e-b209-4b2e-a333-8f9ca1e1a548 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:42.957583 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49708e-b209-4b2e-a333-8f9ca1e1a548 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:42.962508 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:42.963138 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:42.963418 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:42.963720 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:42.972591 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:42.974299 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ab3f-e70d-4bba-995c-19e8ed12c2e8 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:42.984210 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 439/881] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:45.576318 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f236-9f41-495f-b9af-9d7a3815315f None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:45.576874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f236-9f41-495f-b9af-9d7a3815315f None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:45.576874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f236-9f41-495f-b9af-9d7a3815315f None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:45.578199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 443/882] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:45.583379 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74654-47ce-4271-95da-2edcb61af442 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:45.583841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74654-47ce-4271-95da-2edcb61af442 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:45.583945 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74654-47ce-4271-95da-2edcb61af442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:45.603413 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d8b74654-47ce-4271-95da-2edcb61af442 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:45.605826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d8b74654-47ce-4271-95da-2edcb61af442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:45.613448 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 440/883] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:45.952468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f236-9f41-495f-b9af-9d7a3815315f None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:45.963814 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f236-9f41-495f-b9af-9d7a3815315f None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:45.967515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:45.968104 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:45.968376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:45.968642 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:45.977240 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:45.978661 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be06f2-54e8-4a78-8174-6fec202bafc5 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:45.987903 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 444/884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:18:48.434511 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8847-cc4f-4c76-9d24-0deb8c5e8322 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:48.435099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8847-cc4f-4c76-9d24-0deb8c5e8322 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:48.435099 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8847-cc4f-4c76-9d24-0deb8c5e8322 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:48.436403 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 441/885] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:48.441795 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40321d55-c33a-41ff-a2a6-1cec7a1d3a58 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:48.442248 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40321d55-c33a-41ff-a2a6-1cec7a1d3a58 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:48.442351 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40321d55-c33a-41ff-a2a6-1cec7a1d3a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:48.461965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-40321d55-c33a-41ff-a2a6-1cec7a1d3a58 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:48.463146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-40321d55-c33a-41ff-a2a6-1cec7a1d3a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:48.471191 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 445/886] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:48.813028 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a8847-cc4f-4c76-9d24-0deb8c5e8322 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:48.827478 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a8847-cc4f-4c76-9d24-0deb8c5e8322 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:48.830983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:48.831613 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:48.831893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:48.832166 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:48.842104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:48.843572 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508431e3-4dc7-4548-a0f8-386fee09ab11 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:48.853055 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 442/887] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:51.403837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46017-f7a4-45d9-b58e-ac0a20f2202e None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:51.404378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46017-f7a4-45d9-b58e-ac0a20f2202e None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:51.404378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46017-f7a4-45d9-b58e-ac0a20f2202e None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:51.405723 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 446/888] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:51.410921 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf6e9-a852-4bf4-9594-57f6c6af2e78 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:51.411404 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf6e9-a852-4bf4-9594-57f6c6af2e78 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:51.411519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf6e9-a852-4bf4-9594-57f6c6af2e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:51.431094 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-b4daf6e9-a852-4bf4-9594-57f6c6af2e78 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:51.432353 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-b4daf6e9-a852-4bf4-9594-57f6c6af2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:51.440320 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 443/889] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:18:51.780836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46017-f7a4-45d9-b58e-ac0a20f2202e None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:51.791258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46017-f7a4-45d9-b58e-ac0a20f2202e None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:51.794771 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:51.795361 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:51.795663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:51.795932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:51.804639 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:51.806059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2554042-29c1-471d-b534-e0f5510034fc service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:51.815242 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 447/890] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:18:54.554797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f06ab-fcf9-41e3-a46e-89a78ec05757 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:54.555353 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f06ab-fcf9-41e3-a46e-89a78ec05757 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:54.555353 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f06ab-fcf9-41e3-a46e-89a78ec05757 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:54.556710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 444/891] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 25 00:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:18:54.562034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf7bf-d88d-4fb9-aeca-8c9e987121e8 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:54.562478 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf7bf-d88d-4fb9-aeca-8c9e987121e8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:54.562574 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf7bf-d88d-4fb9-aeca-8c9e987121e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:54.581979 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-3bddf7bf-d88d-4fb9-aeca-8c9e987121e8 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:18:54.583142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-3bddf7bf-d88d-4fb9-aeca-8c9e987121e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:18:54.591825 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 448/892] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 25 00:18:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:18:54.936278 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f06ab-fcf9-41e3-a46e-89a78ec05757 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:18:54.946906 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f06ab-fcf9-41e3-a46e-89a78ec05757 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:18:54.951334 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:18:54.951971 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:18:54.952248 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:18:54.952513 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:18:54.961750 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:18:54.963163 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc728-51bc-4d04-8ccd-2f9b3584231b service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:18:54.973747 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 445/893] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:18:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:19:04.577630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=33 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:19:04.969619 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=33 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:20:11.708088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:11.709038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:11.709038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:11.732451 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:20:11.733831 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:11.742457 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 449/894] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:20:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:20:11.750599 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:11.751146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:11.751146 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:11.774702 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:20:11.776266 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:11.784981 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 446/895] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:20:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:20:11.790622 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:11.802967 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e0a92-1830-4dbc-bd4f-db8cd2be76b2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:11.808964 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:11.809585 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:11.809868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:11.810144 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:11.810810 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:20:11.811108 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:11.812175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:20:11.812175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:20:11.812175 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:20:11.813118 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:11.826271 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 450/896] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Oct 25 00:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:20:11.835954 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:11.846434 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be0bd8-a52c-49da-872b-b841bf910c99 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:11.851171 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:11.851812 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:11.852093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:11.853172 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:11.853978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:11.855025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:20:11.855025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:20:11.855025 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:20:11.856283 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:11.884854 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 447/897] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 25 00:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:20:11.889148 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:11.899907 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662935-f22d-4cd5-a4cd-1808dad0e577 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:11.960808 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:11.961426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:11.961726 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:11.962587 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:11.963214 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:11.964250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:20:11.964250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:20:11.964250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:20:11.965718 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:11.988863 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 451/898] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:20:11 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:20:11.993797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.005667 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765678-b358-4978-b284-68b2eb7fbf09 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.011767 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.012356 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.012696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.013010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.013730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.015564 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.029365 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 448/899] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:20:12.033512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.044366 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64f8f7-248d-44db-bd2b-6f7e442deb3b admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.048985 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.049584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.049868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.050141 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.050787 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.052423 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50afb0-d55e-485a-80ad-07c0aa19fc00 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.066666 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 452/900] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:20:12.071106 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.082138 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2415ad-e9e7-4e22-880d-30c1e46dbaf7 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.086795 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.087661 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.087946 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.088237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] PATH_INFO: `/v3/projects/f5dfca9e31fe46e986d83c19cf7ebad4/users/1279ca9cb9f84dbda9afd68b62e3c7fa/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.105170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dfca9e31fe46e986d83c19cf7ebad4, user_id=1279ca9cb9f84dbda9afd68b62e3c7fa, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.109784 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eacad-1440-424c-8bf5-52f2c74fd019 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.124675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 449/901] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:20:12 2022] PUT /identity/v3/projects/f5dfca9e31fe46e986d83c19cf7ebad4/users/1279ca9cb9f84dbda9afd68b62e3c7fa/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:20:12.135964 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d7f5-cbed-484c-955c-3775501024f8 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.136253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d7f5-cbed-484c-955c-3775501024f8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.136527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1d7f5-cbed-484c-955c-3775501024f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.165870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-06a1d7f5-cbed-484c-955c-3775501024f8 None None] MFA Rules not processed for user `1279ca9cb9f84dbda9afd68b62e3c7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:20:12.167088 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-06a1d7f5-cbed-484c-955c-3775501024f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:12.236694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 453/902] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:20:12 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:20:12.251839 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b686f3-b3f7-41fb-ac8b-807fb9d21582 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.252118 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b686f3-b3f7-41fb-ac8b-807fb9d21582 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.252390 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b686f3-b3f7-41fb-ac8b-807fb9d21582 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.254019 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 450/903] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 25 00:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:20:12.260283 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324293-bd73-4828-9f1e-138ae1c83522 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.260626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324293-bd73-4828-9f1e-138ae1c83522 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.261018 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324293-bd73-4828-9f1e-138ae1c83522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.280953 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-65324293-bd73-4828-9f1e-138ae1c83522 None None] MFA Rules not processed for user `dd5e7660d06144ebacc6118fd6192b82`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:20:12.282146 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-65324293-bd73-4828-9f1e-138ae1c83522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:12.331757 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:20:12.341296 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 454/904] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 25 00:20:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:20:12.349112 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b686f3-b3f7-41fb-ac8b-807fb9d21582 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.363524 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b686f3-b3f7-41fb-ac8b-807fb9d21582 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.367265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5e7660d06144ebacc6118fd6192b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.367983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.368787 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.369263 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.378250 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.379734 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.388698 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 451/905] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:20:12 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:20:12.429576 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0be9-1c6e-4b39-b16d-e593752fbd44 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.429866 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0be9-1c6e-4b39-b16d-e593752fbd44 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.430145 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0be9-1c6e-4b39-b16d-e593752fbd44 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.432170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 455/906] 10.222.0.18 () {52 vars in 830 bytes} [Tue Oct 25 00:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:20:12.437405 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.503864 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006960e8-6467-4965-829a-d679be9bf422 service cinder] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.508509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.509406 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.509738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.510014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] PATH_INFO: `/v3/users/1279ca9cb9f84dbda9afd68b62e3c7fa` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.511179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1279ca9cb9f84dbda9afd68b62e3c7fa)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.512240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:20:12.512240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:20:12.512240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:20:12.513436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.587962 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1279ca9cb9f84dbda9afd68b62e3c7fa'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:12.599841 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1279ca9cb9f84dbda9afd68b62e3c7fa'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:12.626169 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1279ca9cb9f84dbda9afd68b62e3c7fa'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:12.642018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1279ca9cb9f84dbda9afd68b62e3c7fa'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:12.642790 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1279ca9cb9f84dbda9afd68b62e3c7fa'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:12.649014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 452/907] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 25 00:20:12 2022] DELETE /identity/v3/users/1279ca9cb9f84dbda9afd68b62e3c7fa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:20:12.654162 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.654439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.654756 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.675205 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:20:12.676559 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:12.740934 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 456/908] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:20:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:20:12.752516 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:12.754014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:12.760309 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:20:12.947856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d16d5-f486-4224-b51d-f452ed1772f0 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:12.951611 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:12.952224 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:12.952504 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:12.952776 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:12.964550 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:12.966252 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45554fb-29b4-48cd-b8da-b413f392f6e5 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:12.976199 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 453/909] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:20:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:20:13.341989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:20:13.343527 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:20:13.361422 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3694ab-035e-45e5-9c71-59b3120d2118 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:20:13.376836 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:20:13.377729 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:20:13.378075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:20:13.378515 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] PATH_INFO: `/v3/projects/f5dfca9e31fe46e986d83c19cf7ebad4` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:20:13.379902 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dfca9e31fe46e986d83c19cf7ebad4)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:20:13.380999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:20:13.380999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:20:13.380999 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:20:13.382374 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:20:13.468498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dfca9e31fe46e986d83c19cf7ebad4', 'request_id': 'req-b5755e18-16cd-4154-85e1-c04b353dfaf3'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:13.474813 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dfca9e31fe46e986d83c19cf7ebad4', 'request_id': 'req-b5755e18-16cd-4154-85e1-c04b353dfaf3'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:13.486821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dfca9e31fe46e986d83c19cf7ebad4', 'request_id': 'req-b5755e18-16cd-4154-85e1-c04b353dfaf3'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:13.507749 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] The token cache is being invalidate because project f5dfca9e31fe46e986d83c19cf7ebad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 00:20:13.508024 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:13.509434 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-b5755e18-16cd-4154-85e1-c04b353dfaf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:20:13.511070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 457/910] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 25 00:20:13 2022] DELETE /identity/v3/projects/f5dfca9e31fe46e986d83c19cf7ebad4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:20:22.971653 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=25 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:20:23.503997 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:21:34.310410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:34.311031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:34.311031 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:34.312319 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 454/911] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:34.317405 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abec01-99f8-49fc-b9e1-22cb382f364a None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:34.317951 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abec01-99f8-49fc-b9e1-22cb382f364a None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:34.317951 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abec01-99f8-49fc-b9e1-22cb382f364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:34.389852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-93abec01-99f8-49fc-b9e1-22cb382f364a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:34.391070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-93abec01-99f8-49fc-b9e1-22cb382f364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:34.495362 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 458/912] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:21:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:21:34.657938 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:34.659909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:34.761129 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5933a1-4bab-41d2-b29e-fb3b88b2940b None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:34.766160 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:34.766775 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:34.767055 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:34.767330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:34.776615 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:34.778254 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c82c-59bd-4a82-a749-0e3e08216239 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:34.788184 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 455/913] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:36.472147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5e6-9b3d-4d75-90c1-ad3e0d75d831 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:36.472567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5e6-9b3d-4d75-90c1-ad3e0d75d831 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:36.472726 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5e6-9b3d-4d75-90c1-ad3e0d75d831 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:36.474288 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 459/914] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:36.481465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ba1a-611f-4eb3-99fb-5247566f6314 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:36.481993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ba1a-611f-4eb3-99fb-5247566f6314 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:36.482505 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ba1a-611f-4eb3-99fb-5247566f6314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:36.504188 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7656ba1a-611f-4eb3-99fb-5247566f6314 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:36.505441 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7656ba1a-611f-4eb3-99fb-5247566f6314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:36.513925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 456/915] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:21:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:21:36.672804 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa5e6-9b3d-4d75-90c1-ad3e0d75d831 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:36.688590 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa5e6-9b3d-4d75-90c1-ad3e0d75d831 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:36.693559 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:36.694151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:36.694430 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:36.694702 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:36.703607 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:36.705181 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1237-0851-4bab-963a-985b4b211f45 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:36.715550 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 460/916] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:38.860518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed089-cc95-4c3b-8083-f0033ed89bd4 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:38.861096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed089-cc95-4c3b-8083-f0033ed89bd4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:38.861096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed089-cc95-4c3b-8083-f0033ed89bd4 None None] PATH_INFO: `/v3` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:38.862324 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 457/917] 10.222.0.43 () {54 vars in 925 bytes} [Tue Oct 25 00:21:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:21:38.869311 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fe48-a5bf-4750-a25b-8381192cec25 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:38.869721 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fe48-a5bf-4750-a25b-8381192cec25 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:38.869843 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fe48-a5bf-4750-a25b-8381192cec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:38.900845 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-0a07fe48-a5bf-4750-a25b-8381192cec25 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:38.902041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-0a07fe48-a5bf-4750-a25b-8381192cec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:38.957401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:21:38.967983 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 461/918] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 25 00:21:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:21:42.841929 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694214c3-5ffa-4b48-8a3b-79a2c0c7ab6e None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:42.842442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694214c3-5ffa-4b48-8a3b-79a2c0c7ab6e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:42.842442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694214c3-5ffa-4b48-8a3b-79a2c0c7ab6e None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:42.843797 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 458/919] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:42.848721 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fa8c-8ac9-4f25-b8ab-21a9800d51f3 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:42.849125 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fa8c-8ac9-4f25-b8ab-21a9800d51f3 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:42.849283 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fa8c-8ac9-4f25-b8ab-21a9800d51f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:42.871511 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-7893fa8c-8ac9-4f25-b8ab-21a9800d51f3 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:42.872734 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-7893fa8c-8ac9-4f25-b8ab-21a9800d51f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:42.881583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 462/920] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:21:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:21:42.892859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694214c3-5ffa-4b48-8a3b-79a2c0c7ab6e None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:42.907380 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694214c3-5ffa-4b48-8a3b-79a2c0c7ab6e None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:42.912304 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:42.912907 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:42.913179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:42.913448 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:42.923078 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:42.924708 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e85f-9110-4e56-836a-5d71ca1f6e11 service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:42.935859 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 459/921] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:48.791972 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb66357-eb51-46ad-9082-79ed1ada3164 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:48.792555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb66357-eb51-46ad-9082-79ed1ada3164 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:48.792555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb66357-eb51-46ad-9082-79ed1ada3164 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:48.794735 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 463/922] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:48.799826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e74c-2677-40f5-9b97-1af448169338 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:48.800256 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e74c-2677-40f5-9b97-1af448169338 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:48.800408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e74c-2677-40f5-9b97-1af448169338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:48.820956 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-28e2e74c-2677-40f5-9b97-1af448169338 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:48.822163 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-28e2e74c-2677-40f5-9b97-1af448169338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:48.830387 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 460/923] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:21:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:21:48.994137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb66357-eb51-46ad-9082-79ed1ada3164 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:49.009221 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb66357-eb51-46ad-9082-79ed1ada3164 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:49.014387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:49.014981 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:49.015261 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:49.015563 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:49.023821 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:49.025435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92097d-e5d8-4338-957f-7f370b0d5760 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:49.035694 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 464/924] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:50.677471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6e5c6-8cd7-496c-b7f5-5c5b9201426f None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:50.677998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6e5c6-8cd7-496c-b7f5-5c5b9201426f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:50.677998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6e5c6-8cd7-496c-b7f5-5c5b9201426f None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:50.679275 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 461/925] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 00:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:50.684575 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae68f6-c658-4515-be8f-4d4174ee08f4 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:50.685012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae68f6-c658-4515-be8f-4d4174ee08f4 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:50.685215 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae68f6-c658-4515-be8f-4d4174ee08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:50.704970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-b7ae68f6-c658-4515-be8f-4d4174ee08f4 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:50.706180 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-b7ae68f6-c658-4515-be8f-4d4174ee08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:50.713883 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 465/926] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 00:21:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:21:50.872533 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6e5c6-8cd7-496c-b7f5-5c5b9201426f None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:50.886147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6e5c6-8cd7-496c-b7f5-5c5b9201426f None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:50.891837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:50.892432 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:50.892710 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:50.892982 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:50.900943 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:50.902509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2d305-cb14-43e5-9a56-0939ca140253 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:50.911901 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 462/927] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:55.231014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:55.231609 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:55.231719 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:55.233037 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 466/928] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:55.238168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38378d-fbb5-484d-bbe7-192206d25efd None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:55.238680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38378d-fbb5-484d-bbe7-192206d25efd None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:55.238785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38378d-fbb5-484d-bbe7-192206d25efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:55.258701 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-8f38378d-fbb5-484d-bbe7-192206d25efd None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:55.259959 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-8f38378d-fbb5-484d-bbe7-192206d25efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:55.268448 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 463/929] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:21:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:21:55.610313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:55.612016 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:55.670874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf68d0-852e-4869-bceb-c443013bd58c None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:55.674461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:55.675093 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:55.675374 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:55.675704 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:55.686376 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:55.687875 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011f6c1-0422-4154-8343-6141f53880fc service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:55.697387 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 467/930] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:21:58.157241 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fc71-c9cf-40c0-a5c3-3636b57d115d None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:58.157830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fc71-c9cf-40c0-a5c3-3636b57d115d None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:58.157830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fc71-c9cf-40c0-a5c3-3636b57d115d None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:58.159115 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 464/931] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:21:58.164618 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d75c-6a86-4cc3-ab8a-fa75dbe723ba None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:58.165074 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d75c-6a86-4cc3-ab8a-fa75dbe723ba None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:58.165171 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d75c-6a86-4cc3-ab8a-fa75dbe723ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:58.184799 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-0c19d75c-6a86-4cc3-ab8a-fa75dbe723ba None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:21:58.186018 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-0c19d75c-6a86-4cc3-ab8a-fa75dbe723ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:21:58.193830 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 468/932] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:21:58.535521 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fc71-c9cf-40c0-a5c3-3636b57d115d None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:21:58.547690 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fc71-c9cf-40c0-a5c3-3636b57d115d None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:21:58.551124 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:21:58.551754 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:21:58.552024 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:21:58.552291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:21:58.561867 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:21:58.563290 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d23b-e9b2-43de-94cd-8d1fe2246fa6 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:21:58.572566 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 465/933] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:21:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:22:02.516320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:02.516931 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:02.516931 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:02.518184 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 469/934] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:22:02.523586 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd3c25-cfa8-4ac0-b07c-7eab8683937b None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:02.524085 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd3c25-cfa8-4ac0-b07c-7eab8683937b None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:02.524199 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd3c25-cfa8-4ac0-b07c-7eab8683937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:02.543984 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-1ddd3c25-cfa8-4ac0-b07c-7eab8683937b None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:22:02.545186 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-1ddd3c25-cfa8-4ac0-b07c-7eab8683937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:22:02.553154 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 466/935] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:22:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:22:02.916965 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:22:02.919547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:22:03.008974 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9c1c1-9f9e-4918-ba77-cfbf1f6a8939 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:22:03.012731 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5e7660d06144ebacc6118fd6192b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:22:03.013368 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:03.013607 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:03.013874 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:03.023333 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:22:03.024794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fbdd-de81-427e-a62b-19abcb35a239 service cinder] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:22:03.036058 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 470/936] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:22:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:22:05.482715 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:05.483713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:05.483713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:05.484643 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 467/937] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:22:05.490358 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dec4-def2-4d05-814f-61fe1aba6e66 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:05.491121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dec4-def2-4d05-814f-61fe1aba6e66 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:05.491121 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dec4-def2-4d05-814f-61fe1aba6e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:05.510284 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-e1d3dec4-def2-4d05-814f-61fe1aba6e66 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:22:05.511496 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-e1d3dec4-def2-4d05-814f-61fe1aba6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:22:05.519856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 471/938] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 00:22:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:22:05.872902 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:22:05.874578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:22:05.882087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=70 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:22:05.888909 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cf3c-edb4-47c2-b349-02c83fb2b63e None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:22:05.892428 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5e7660d06144ebacc6118fd6192b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:22:05.893021 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:22:05.893297 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:22:05.893568 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:22:05.902518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:22:05.904527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e17a47-3352-4414-ade7-53975f231997 service cinder] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:22:05.913725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 468/939] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:22:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:22:15.505461 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=75 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:22:15.909678 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=5 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:21.569996 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.570912 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.570912 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.602268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:21.610378 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:21.618365 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 472/940] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:21.629417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.630371 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.630371 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.653658 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:21.654920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:21.662983 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 469/941] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:21.667656 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.678109 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea1874-3d0b-4c6f-9d31-a1bc0dc1aeb2 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.682788 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.683388 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.683717 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.683987 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.684630 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:23:21.684935 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.686523 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7a1f2-42c2-415d-8449-19cc5e79049c admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.699398 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 473/942] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Oct 25 00:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 00:23:21.707595 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.717322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db588b27-33fe-44ee-b9da-6adb34922f6a None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.722152 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.722768 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.723051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.723326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.724005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.725925 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.737774 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e2bd-f2dc-453b-9afc-dbbb2132a91c None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.738060 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e2bd-f2dc-453b-9afc-dbbb2132a91c None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.738340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e2bd-f2dc-453b-9afc-dbbb2132a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.758728 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-fcd1e2bd-f2dc-453b-9afc-dbbb2132a91c None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:21.759983 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-fcd1e2bd-f2dc-453b-9afc-dbbb2132a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:21.765901 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 470/943] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:23:21.768002 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 474/944] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:21.774302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.776948 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.777232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.777555 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.799941 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:21.801154 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:21.842247 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e30f9-66e3-4e7c-bfa4-09d313b66c85 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.847356 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.847993 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.848277 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.848549 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.849183 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.850270 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: WARNING py.warnings [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:23:21.850270 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: warnings.warn(msg) Oct 25 00:23:21.850270 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: Oct 25 00:23:21.851582 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.867956 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 475/945] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:21.873019 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.878752 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 471/946] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:23:21.879900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.883104 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b20ec-edce-4d93-bfcb-53b2f43d50b1 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.887908 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.888512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.888790 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.889059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.889668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f17a3-f19b-4d3d-ad70-f102b254226f admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.889781 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 00:23:21.890020 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.891703 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.895893 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.896501 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.896847 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.897126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.897772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.899361 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.903631 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 476/947] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Oct 25 00:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 00:23:21.910204 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 472/948] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 00:23:21.912117 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.913960 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.923312 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa3f7-f3b1-4d44-ac9e-73cdfb37b7fc admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.924438 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c059a-dec0-493a-8d50-04699acc2fab admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.927970 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.928572 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.928853 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.928958 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.929193 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] PATH_INFO: `/v3/projects` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.929513 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.929796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.929888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.930071 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.930704 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.930820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: WARNING py.warnings [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 00:23:21.930820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: warnings.warn(msg) Oct 25 00:23:21.930820 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: Oct 25 00:23:21.938202 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.938398 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.944230 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 473/949] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 00:23:21.948288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.958402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2830-56df-43b1-9bac-d283b22ba51b admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:21.963876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:21.964526 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:21.964818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:21.965088 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] PATH_INFO: `/v3/projects/717c70fe784047d6891161eb1d023096/users/0827030802ef47e89eba84d5be4f2803/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:21.970701 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 477/950] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:23:21.971570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:21.982601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717c70fe784047d6891161eb1d023096, user_id=0827030802ef47e89eba84d5be4f2803, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:21.986170 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e80b31-2af8-4b3c-9f88-aeb03574ea57 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:21.999941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 474/951] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:21 2022] PUT /identity/v3/projects/717c70fe784047d6891161eb1d023096/users/0827030802ef47e89eba84d5be4f2803/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:23:22.004912 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.005192 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.005459 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.024029 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:22.025219 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:22.037512 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df34b-90a5-4a8b-a6ae-666e2ef35054 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.080684 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:22.086056 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 475/952] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:22.096962 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:22.097169 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.097788 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.098067 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.098345 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.098978 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.100920 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.105801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:22.126211 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 478/953] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:23:21 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:23:22.130611 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:22.140258 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf112d7-11e1-4fb6-b7d2-a06206a4b4d8 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.145426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.146022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.146305 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.146584 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.147216 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.148855 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.163117 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 479/954] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 00:23:22.163322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a4923-43d4-4a88-a4dd-d430d2ac6e47 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.164233 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:22.165466 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.166073 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.166347 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.166616 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.174949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11dce-27d4-47dc-b8d4-909a7023ccd8 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.177324 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.178756 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.179868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.180494 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.180772 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.181042 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.181676 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.183253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63bbfd-b39e-4676-9581-2b6257373b8c admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.188687 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 476/955] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:23:22.194364 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 480/956] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:23:22.198821 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:22.209020 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613003-b099-43f6-a324-cd81955580da service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.214352 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.214717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.214995 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.215274 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] PATH_INFO: `/v3/projects/23b6eb1791c44abb901fd68247590d5f/users/b01d70ab07844e24a148ed4169719dd8/roles/9c0837507af34315976055cb8e53ab43` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.231403 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b6eb1791c44abb901fd68247590d5f, user_id=b01d70ab07844e24a148ed4169719dd8, role_id=9c0837507af34315976055cb8e53ab43)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.234730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.247950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 477/957] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:22 2022] PUT /identity/v3/projects/23b6eb1791c44abb901fd68247590d5f/users/b01d70ab07844e24a148ed4169719dd8/roles/9c0837507af34315976055cb8e53ab43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:23:22.253484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75886-ec3c-492b-b78f-7b0457748806 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.253776 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75886-ec3c-492b-b78f-7b0457748806 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.254194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75886-ec3c-492b-b78f-7b0457748806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.274786 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a6a75886-ec3c-492b-b78f-7b0457748806 None None] MFA Rules not processed for user `1621e081d9274dc6a28173f447bc4436`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:22.276138 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a6a75886-ec3c-492b-b78f-7b0457748806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:22.341776 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 481/958] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:22.352863 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:22.354655 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:22.444441 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7182110-9a8f-42ae-adcc-92dee068fd05 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:22.448400 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:22.449195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:22.450092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:22.450413 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:22.462133 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:22.463801 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:22.474237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 478/959] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:28.250780 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.251357 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.251503 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.318440 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] MFA Rules not processed for user `b01d70ab07844e24a148ed4169719dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:28.320454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:28.510760 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 482/960] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:28.510977 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.521311 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa04b9-fd66-49e8-bfaf-d95679ee8d66 service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:28.528011 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:28.528385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.528730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.529007 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.529952 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:28.532522 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62498f7d-5bac-4778-8686-8b7a5ef7901b admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:28.594635 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 479/961] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:23:28.595906 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.613740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a167ba-e8fe-4a21-a5b7-d609aa5b8efe None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:28.622190 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.622484 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.622768 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.663491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:28.664742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:28.702385 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:28.732014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:28.732659 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.732942 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.733214 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] PATH_INFO: `/v3/users` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.735280 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:28.737785 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:28.764863 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:28.788595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 483/962] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:23:28.793081 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.810868 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495681ad-6b8c-40b9-8645-115250ec0b5b admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:28.820472 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 480/963] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:28.825173 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.828371 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:28.829170 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.829489 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.829849 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.830514 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:28.832332 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:28.840252 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658d4e-4c6b-4e78-9709-2e8806aca3b4 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:28.846456 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:28.847262 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.847675 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.848051 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] PATH_INFO: `/v3/projects` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.848799 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:28.851264 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:28.851460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 484/964] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:23:28.852420 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.864054 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eada1-7081-4ee1-bbe3-5852d79bb368 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:28.869439 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:28.870130 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:28.870406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:28.870791 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] PATH_INFO: `/v3/projects/884b3c2d448647b3b4f9f0de242730b7/users/80bc6f48abf1486e8f63b32dfb37ced9/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:28.891949 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 481/965] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 00:23:28.892188 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884b3c2d448647b3b4f9f0de242730b7, user_id=80bc6f48abf1486e8f63b32dfb37ced9, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:28.896049 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:28.896226 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.912794 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 485/966] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:28 2022] PUT /identity/v3/projects/884b3c2d448647b3b4f9f0de242730b7/users/80bc6f48abf1486e8f63b32dfb37ced9/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:23:28.916862 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:28.972845 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f542f-9157-4e7e-b35d-28300d79222c admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.011864 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281dba-6577-4a29-8907-49f7c71cd549 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.019985 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.020876 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.021213 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.021583 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] PATH_INFO: `/v3/roles` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.022243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.023909 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.039603 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 486/967] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 00:23:29.040371 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.041218 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.041652 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.041884 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:29.041998 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] PATH_INFO: `/v3/users` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.042636 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.044644 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.055886 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777d3da-27fb-4bb9-a1e0-73cb590a0161 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.067877 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.068644 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.068931 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.069229 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] PATH_INFO: `/v3/projects/884b3c2d448647b3b4f9f0de242730b7/users/80bc6f48abf1486e8f63b32dfb37ced9/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.071956 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884b3c2d448647b3b4f9f0de242730b7, user_id=80bc6f48abf1486e8f63b32dfb37ced9, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.074647 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.079837 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 482/968] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 25 00:23:28 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 00:23:29.086147 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:29.092894 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 487/969] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:29 2022] PUT /identity/v3/projects/884b3c2d448647b3b4f9f0de242730b7/users/80bc6f48abf1486e8f63b32dfb37ced9/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:23:29.098665 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645316-f11f-4705-a5b7-5364f5b33884 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.172755 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.174078 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.174436 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.174784 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.175817 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.178066 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.180006 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:29.196407 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 483/970] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 00:23:29.201346 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:29.221573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694081-0bf7-4812-9019-8ae6d2759849 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.228070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.228942 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.229135 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.229406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] PATH_INFO: `/v3/projects/d4334e8f46084ca195ac010d7d248d1e/users/78985d4e87c24a18976c01624754a370/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.245838 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4334e8f46084ca195ac010d7d248d1e, user_id=78985d4e87c24a18976c01624754a370, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.249026 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.268720 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 488/971] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:29 2022] PUT /identity/v3/projects/d4334e8f46084ca195ac010d7d248d1e/users/78985d4e87c24a18976c01624754a370/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:23:29.272912 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:29.286138 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783cc1-5dd7-4fa8-b139-daab569e38ba admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.388439 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.389206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.389589 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.389746 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] PATH_INFO: `/v3/roles` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.391093 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.393302 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b564-6869-4466-8846-d549fd712084 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.414026 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 484/972] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 25 00:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 00:23:29.418050 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:29.454500 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b422-3b4f-45f1-89ab-e666d4a25360 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:29.461935 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:29.478891 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:29.480590 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:29.482396 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] PATH_INFO: `/v3/projects/d4334e8f46084ca195ac010d7d248d1e/users/78985d4e87c24a18976c01624754a370/roles/70e01e34b4914943a949ed0ea649288a` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:29.488410 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4334e8f46084ca195ac010d7d248d1e, user_id=78985d4e87c24a18976c01624754a370, role_id=70e01e34b4914943a949ed0ea649288a)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:29.496888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:29.513692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 489/973] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 25 00:23:29 2022] PUT /identity/v3/projects/d4334e8f46084ca195ac010d7d248d1e/users/78985d4e87c24a18976c01624754a370/roles/70e01e34b4914943a949ed0ea649288a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:23:35.339082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5790-6a93-4b0e-92fa-5342b2b121bf None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:35.339683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5790-6a93-4b0e-92fa-5342b2b121bf None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:35.339683 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5790-6a93-4b0e-92fa-5342b2b121bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:35.400527 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-43cf5790-6a93-4b0e-92fa-5342b2b121bf None None] MFA Rules not processed for user `80bc6f48abf1486e8f63b32dfb37ced9`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:35.401978 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-43cf5790-6a93-4b0e-92fa-5342b2b121bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:35.555491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 485/974] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:35 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:35.564235 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:35.568313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:35.667165 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:35.732167 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac013-8daa-4727-8c6e-7cb085e29cdc admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:35.746463 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a90ffe3e5d438d8aa888e20cd40bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:35.751616 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:35.752884 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:35.753325 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:35.833383 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:35.834946 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:35.848663 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 490/975] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:35 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:35.989145 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920030a-737b-4868-b1c5-35d2854be8b0 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:35.998391 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920030a-737b-4868-b1c5-35d2854be8b0 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:35.998920 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920030a-737b-4868-b1c5-35d2854be8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:36.062253 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-2920030a-737b-4868-b1c5-35d2854be8b0 None None] MFA Rules not processed for user `78985d4e87c24a18976c01624754a370`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:36.063737 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-2920030a-737b-4868-b1c5-35d2854be8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:36.220669 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 486/976] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:35 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:36.228613 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:36.238008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafa63-cf86-4e14-80f9-1ef9e984371e service glance] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:36.241858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a90ffe3e5d438d8aa888e20cd40bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:36.242481 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:36.242763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:36.243038 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:36.338546 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:36.340687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4d09-bb6a-4422-bb3a-20ab60066991 service glance] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:36.370370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 491/977] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:36 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:44.849422 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b68c-ccd3-4be9-9276-92cefcabda0e None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:44.850010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b68c-ccd3-4be9-9276-92cefcabda0e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:44.850010 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b68c-ccd3-4be9-9276-92cefcabda0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:44.860057 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=100 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:44.884962 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-1170b68c-ccd3-4be9-9276-92cefcabda0e None None] MFA Rules not processed for user `b01d70ab07844e24a148ed4169719dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:44.886557 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-1170b68c-ccd3-4be9-9276-92cefcabda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:44.898330 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 487/978] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:23:44 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:45.239915 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5a9e-5912-40e8-bbef-6c5ed2865bff None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.241092 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5a9e-5912-40e8-bbef-6c5ed2865bff None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.241426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5a9e-5912-40e8-bbef-6c5ed2865bff None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.243188 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 492/979] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:23:45.250871 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49820-fa3b-47c8-a70f-6e631dcb7c25 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.251451 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49820-fa3b-47c8-a70f-6e631dcb7c25 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.251876 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49820-fa3b-47c8-a70f-6e631dcb7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.291342 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-bff49820-fa3b-47c8-a70f-6e631dcb7c25 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:45.292878 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-bff49820-fa3b-47c8-a70f-6e631dcb7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:45.377748 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 488/980] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:23:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:45.383278 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.383597 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.383870 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.385199 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 493/981] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 25 00:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:23:45.390898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa26e-c479-47f7-9ec4-b4e4d1866183 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.391288 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa26e-c479-47f7-9ec4-b4e4d1866183 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.391747 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa26e-c479-47f7-9ec4-b4e4d1866183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.414773 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7eefa26e-c479-47f7-9ec4-b4e4d1866183 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:45.416473 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7eefa26e-c479-47f7-9ec4-b4e4d1866183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:45.428918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 489/982] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 25 00:23:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:45.447858 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:45.450789 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:45.472012 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c9dc-9fa7-431a-89fb-22e5d9687b05 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:45.475454 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a90ffe3e5d438d8aa888e20cd40bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:45.476047 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.476517 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.476796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.487283 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:45.488778 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce40e44-f4f3-40f7-8cd9-bb8cae4d6187 service glance] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:45.500558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 494/983] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:45.871179 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5f70-b508-4f05-b9a1-23d09eaa36f7 None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.871753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5f70-b508-4f05-b9a1-23d09eaa36f7 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.871753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5f70-b508-4f05-b9a1-23d09eaa36f7 None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.873178 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 490/984] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 25 00:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:23:45.880009 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1dd2-214e-43ed-8a50-a63372b28465 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.880431 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1dd2-214e-43ed-8a50-a63372b28465 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.880770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1dd2-214e-43ed-8a50-a63372b28465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.901598 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-e4bc1dd2-214e-43ed-8a50-a63372b28465 None None] MFA Rules not processed for user `ac44864c41224ca58e8a489209f878c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:45.903151 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-e4bc1dd2-214e-43ed-8a50-a63372b28465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:45.962856 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 495/985] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 25 00:23:45 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:45.974409 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e5f70-b508-4f05-b9a1-23d09eaa36f7 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:45.986292 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e5f70-b508-4f05-b9a1-23d09eaa36f7 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:45.990156 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:45.990776 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:45.991050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:45.991316 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:45.999742 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:46.001420 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:46.009736 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 491/986] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:45 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:23:46.569059 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7fe6-524b-4760-8a34-62cf9381c0b7 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.569540 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7fe6-524b-4760-8a34-62cf9381c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.569730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7fe6-524b-4760-8a34-62cf9381c0b7 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.570919 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 496/987] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:23:46.580264 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:46.581042 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072f4a-435f-4541-957f-5c7bcfbdfdce None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.581326 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072f4a-435f-4541-957f-5c7bcfbdfdce None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.581597 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072f4a-435f-4541-957f-5c7bcfbdfdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.605065 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-7e072f4a-435f-4541-957f-5c7bcfbdfdce None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:46.606492 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-7e072f4a-435f-4541-957f-5c7bcfbdfdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:46.617692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 497/988] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:23:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:46.634401 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1d42-8005-46ab-8389-69736785b076 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.634705 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1d42-8005-46ab-8389-69736785b076 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.635453 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1d42-8005-46ab-8389-69736785b076 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.637128 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 498/989] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 25 00:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:23:46.643252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.643645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.644005 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.657014 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0183-857e-4e83-b7e0-4813a889cbcf service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:46.662672 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:46.663322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.663650 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.663959 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.664952 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:46.666080 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:46.666290 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:46.675762 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 499/990] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 25 00:23:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:23:46.678913 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:46.680543 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae68e4-941f-451e-a864-94ce7323b784 service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:46.689118 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:46.692174 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 492/991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:46 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:46.698680 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0435e7-f940-48d2-a226-0f13c57818d6 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:46.703826 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:46.704435 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:46.704713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:46.704981 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:46.712681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:23:46.715823 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:46.719034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:46.731880 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 500/992] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:56.541663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a1c9-2e5e-44ed-aacf-b4faa731fcd5 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:56.542253 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a1c9-2e5e-44ed-aacf-b4faa731fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:56.542490 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a1c9-2e5e-44ed-aacf-b4faa731fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:56.566335 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-d939a1c9-2e5e-44ed-aacf-b4faa731fcd5 None None] MFA Rules not processed for user `ac44864c41224ca58e8a489209f878c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:56.567593 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-d939a1c9-2e5e-44ed-aacf-b4faa731fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:56.574465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 493/993] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 25 00:23:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:56.591940 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:56.607344 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e748-0ebe-4b63-ad28-164419fd9509 service neutron] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:56.612033 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:56.612852 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:56.613142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:56.613426 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:56.625274 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:56.627837 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd48ab-8d64-40cf-8bc8-d34d9ab80e2f service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:56.639057 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 501/994] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:23:57.588950 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8893-d2e3-4e7a-adf3-57b69752a42a None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:57.589560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8893-d2e3-4e7a-adf3-57b69752a42a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:57.589932 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8893-d2e3-4e7a-adf3-57b69752a42a None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:57.592898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 494/995] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:23:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:23:57.752558 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2dc8-3948-451e-851c-1b154d4b6b31 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:57.753251 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2dc8-3948-451e-851c-1b154d4b6b31 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:57.753370 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2dc8-3948-451e-851c-1b154d4b6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:57.785335 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-a66a2dc8-3948-451e-851c-1b154d4b6b31 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:23:57.788006 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-a66a2dc8-3948-451e-851c-1b154d4b6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:23:57.802658 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 502/996] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:23:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:23:57.824898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b8893-d2e3-4e7a-adf3-57b69752a42a None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:23:57.845196 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b8893-d2e3-4e7a-adf3-57b69752a42a None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:23:57.851256 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:23:57.852340 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:23:57.852542 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:23:57.852894 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:23:57.866087 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:23:57.866680 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6309492-4d50-4bcb-acb2-aebef6fbc3db service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:23:57.881037 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 495/997] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:23:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:24:04.962582 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7f98-5fc6-4755-aefa-cf8cc8e5886b None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:04.963156 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7f98-5fc6-4755-aefa-cf8cc8e5886b None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:04.963156 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7f98-5fc6-4755-aefa-cf8cc8e5886b None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:04.964502 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 503/998] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:24:04.972713 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:04.973244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:04.973244 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:04.997560 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:24:04.999117 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:24:05.009150 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 496/999] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:24:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:24:05.024484 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7f98-5fc6-4755-aefa-cf8cc8e5886b None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:24:05.041055 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7f98-5fc6-4755-aefa-cf8cc8e5886b None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:24:05.046361 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:24:05.047220 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:05.047617 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:05.047879 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:05.057176 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:24:05.058758 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b48ab-4afa-41f0-80b5-bfe98b645b5f service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:24:05.070547 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 504/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:24:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:24:14.991953 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=89 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:24:15.066460 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=17 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:24:18.920941 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:24:18.931258 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28919-5e27-472d-8765-03ea1e74f161 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:24:18.934830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:24:18.935442 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:18.935771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:18.936076 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:18.946140 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:24:18.947592 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e324-21d9-4ad2-bc71-0e36505d4cb3 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:24:18.957498 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 497/1001] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:24:18 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:24:23.252423 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6774-8c05-4ba9-93b7-73888dce11c1 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:23.253469 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6774-8c05-4ba9-93b7-73888dce11c1 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:23.253891 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6774-8c05-4ba9-93b7-73888dce11c1 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:23.258833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 505/1002] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:24:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:24:23.319210 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bef2e-1bbd-4213-b93f-b791bf91a146 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:23.319809 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bef2e-1bbd-4213-b93f-b791bf91a146 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:23.319809 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bef2e-1bbd-4213-b93f-b791bf91a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:23.342217 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-140bef2e-1bbd-4213-b93f-b791bf91a146 None None] MFA Rules not processed for user `e1a5bdb4170143378833ce36284c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:24:23.343552 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-140bef2e-1bbd-4213-b93f-b791bf91a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:24:23.353783 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 498/1003] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:24:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:24:23.387931 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd6774-8c05-4ba9-93b7-73888dce11c1 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:24:23.425996 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd6774-8c05-4ba9-93b7-73888dce11c1 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:24:23.436347 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:24:23.437615 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:23.439943 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:23.440730 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:23.464756 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:24:23.468770 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e228166-7e2d-43b7-938c-1f29b68e1583 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:24:23.497034 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 506/1004] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:24:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:24:33.335726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=9 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:24:33.480892 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=6 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:24:38.663826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:38.669298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:38.669298 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:38.685141 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:24:38.686430 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:24:38.693649 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 499/1005] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:24:38 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:24:39.056194 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51509250-19e0-4135-9021-8ce480551b10 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:39.056766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51509250-19e0-4135-9021-8ce480551b10 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:39.056766 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51509250-19e0-4135-9021-8ce480551b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:39.076152 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-51509250-19e0-4135-9021-8ce480551b10 None None] MFA Rules not processed for user `ac44864c41224ca58e8a489209f878c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:24:39.077357 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-51509250-19e0-4135-9021-8ce480551b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:24:39.084268 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 507/1006] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 25 00:24:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:24:39.096458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:24:39.105805 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6874fa-b09d-4445-9357-ec8914c71e2a None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:24:39.109315 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:24:39.109930 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:24:39.110211 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:24:39.110485 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:24:39.117753 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:24:39.119187 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b0401-8c34-4c5d-bd76-7f21ae51ad3b service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:24:39.127365 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 500/1007] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:24:39 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:24:49.071220 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:24:49.123726 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=9 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:25:02.779631 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752a1b-4333-4c59-bd1e-3b2d7bf077c0 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:25:02.780161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752a1b-4333-4c59-bd1e-3b2d7bf077c0 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:25:02.780161 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752a1b-4333-4c59-bd1e-3b2d7bf077c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:25:02.800807 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-c6752a1b-4333-4c59-bd1e-3b2d7bf077c0 None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:25:02.802595 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-c6752a1b-4333-4c59-bd1e-3b2d7bf077c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:25:02.809406 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 508/1008] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:25:02 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:25:12.795979 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:25:17.604157 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:25:17.604730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:25:17.604730 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:25:17.623601 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:25:17.624725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:25:17.632310 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 501/1009] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:25:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:25:27.618622 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:26:14.132685 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:26:14.133216 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:26:14.133216 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:26:14.152070 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:26:14.153267 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:26:14.160455 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 509/1010] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:26:14 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:26:24.147183 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=3 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:26:26.044563 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:26:26.063465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fadc3-9a45-4785-9026-b4c937278de1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:26:26.067593 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:26:26.068189 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:26:26.068464 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:26:26.068735 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:26:26.077487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:26:26.078898 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f88ba-eeac-4a30-82af-19f3701ad0ef service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:26:26.088245 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 502/1011] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:26:26 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:26:36.084167 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=10 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:26:45.085041 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:26:45.108087 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2f40-9042-4f8c-9ad5-fe0ce98cc490 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:26:45.113229 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:26:45.114898 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:26:45.115321 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:26:45.115623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:26:45.124840 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:26:45.126485 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:26:45.137122 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 510/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:26:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:26:55.132941 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=10 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:28:10.292698 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:10.293201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:10.293293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:10.312509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] MFA Rules not processed for user `b01d70ab07844e24a148ed4169719dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:28:10.313696 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:28:10.320377 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 503/1013] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:28:10 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:28:20.306785 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=3 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:28:35.593888 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:28:35.604320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39b877-28cb-4d83-9a35-6049c2eac5d2 service placement] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:28:35.607505 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:28:35.608105 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:35.608380 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:35.608677 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:35.618137 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:28:35.619773 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c7dee-e350-4afa-9a54-9358d50b56bd service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:28:35.629313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 511/1014] 10.222.0.18 () {60 vars in 1396 bytes} [Tue Oct 25 00:28:35 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2816 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:28:35.961976 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:28:35.975450 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d29a-0a2b-49a2-8117-12a3e4a54686 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:28:35.980488 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:28:35.981132 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:35.981578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:35.981980 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:35.996539 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:28:35.998385 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:28:36.011143 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 504/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:28:35 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:28:38.113207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:38.113665 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:38.113978 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:38.137681 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:28:38.139241 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:28:38.150468 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 512/1016] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:28:38 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:28:45.110830 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:28:45.119082 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b72e1-33f3-472c-ba0e-6b391852fd24 service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:28:45.122668 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:28:45.123270 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:45.123578 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:45.123845 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:45.134046 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:28:45.135509 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:28:45.154972 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 505/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:28:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:28:46.330687 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:28:46.340402 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1258b7-d7bc-4eab-b36b-04d8b6273dad None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:28:46.343949 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:28:46.344626 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:28:46.344911 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:28:46.345142 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:28:46.354881 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:28:46.356338 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:28:46.367313 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 513/1018] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:28:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:28:55.152593 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=16 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:28:56.362796 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=15 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:29:04.099457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:29:04.108573 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c8c76-b65d-40e8-b6f9-468e7fc04afe service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:29:04.112918 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:29:04.113532 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:29:04.113809 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:29:04.114077 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:29:04.121691 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:29:04.123137 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:29:04.131460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 506/1019] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:29:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:29:14.127856 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=6 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:29:49.696331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:29:49.713255 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682378-a634-4acf-8a5b-ca97712848db service neutron] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:29:49.721159 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:29:49.722131 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:29:49.722602 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:29:49.723286 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:29:49.733897 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:29:49.736029 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:29:49.765207 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 514/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:29:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:29:56.422005 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:29:56.435380 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9749f9-d6ee-49aa-a5c0-dcb46df2f199 service neutron] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:29:56.441460 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:29:56.442587 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:29:56.443113 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:29:56.443577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:29:56.453292 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:29:56.454900 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a5657-7788-4a61-9b46-391163830383 service nova] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:29:56.465657 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 507/1021] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:29:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:29:57.853678 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:29:57.862713 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbef-f4cb-4c71-ae20-a78bc99df59e service nova] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:29:57.866646 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:29:57.867247 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:29:57.867563 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:29:57.867833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:29:57.929301 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:29:57.930721 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905cd51-263e-431a-a710-1e4c601711e2 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:29:57.949998 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 515/1022] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:29:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:30:01.670940 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddd47-ec63-4343-8384-b2d411b0aa4e None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:01.671641 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddd47-ec63-4343-8384-b2d411b0aa4e None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:01.672054 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddd47-ec63-4343-8384-b2d411b0aa4e None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:01.674402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 508/1023] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:30:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:30:01.685022 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244aff-a0ad-4bb8-afa0-6652c47e8c28 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:01.685833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244aff-a0ad-4bb8-afa0-6652c47e8c28 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:01.685833 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244aff-a0ad-4bb8-afa0-6652c47e8c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:01.779892 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-ca244aff-a0ad-4bb8-afa0-6652c47e8c28 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:30:01.781400 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ca244aff-a0ad-4bb8-afa0-6652c47e8c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:01.793932 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 516/1024] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:30:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 00:30:01.808195 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddd47-ec63-4343-8384-b2d411b0aa4e None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:01.823325 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddd47-ec63-4343-8384-b2d411b0aa4e None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:01.831126 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:01.832206 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:01.832708 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:01.833237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:01.849096 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:01.851265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa67c-a030-476f-b75a-ec2a5325191e service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:01.869643 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 509/1025] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:30:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 00:30:05.908440 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb468-43ab-48c8-8546-bff7c795eaa8 None None] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:05.909039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb468-43ab-48c8-8546-bff7c795eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:05.909039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb468-43ab-48c8-8546-bff7c795eaa8 None None] PATH_INFO: `/` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:05.911204 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 517/1026] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 25 00:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 00:30:05.923367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:05.924349 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:05.925107 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:05.961648 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:30:05.962926 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:05.976609 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 510/1027] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 25 00:30:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:30:05.989894 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb468-43ab-48c8-8546-bff7c795eaa8 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:06.006264 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:06.017519 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cdc0d-5720-4072-a16a-9431987b3af1 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:06.020510 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb468-43ab-48c8-8546-bff7c795eaa8 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:06.024251 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:06.025132 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:06.025437 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:06.025741 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] PATH_INFO: `/v3/users/b01d70ab07844e24a148ed4169719dd8` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:06.027191 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01d70ab07844e24a148ed4169719dd8)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:06.029546 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:06.031044 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:06.032832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:06.033342 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:06.033945 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:06.047001 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:06.048761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:06.063692 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 518/1028] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:30:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:30:06.106261 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01d70ab07844e24a148ed4169719dd8'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.117781 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01d70ab07844e24a148ed4169719dd8'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.136794 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01d70ab07844e24a148ed4169719dd8'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.144491 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01d70ab07844e24a148ed4169719dd8'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.145796 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01d70ab07844e24a148ed4169719dd8'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.152938 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 511/1029] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 25 00:30:06 2022] DELETE /identity/v3/users/b01d70ab07844e24a148ed4169719dd8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:30:06.370739 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:06.391008 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afa2-a3f0-4851-8f26-3389c92e9c51 service placement] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:06.466262 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:06.467129 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:06.467645 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:06.468027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] PATH_INFO: `/v3/projects/23b6eb1791c44abb901fd68247590d5f` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:06.469521 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b6eb1791c44abb901fd68247590d5f)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:06.472021 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:06.503533 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=100 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:06.531600 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b6eb1791c44abb901fd68247590d5f', 'request_id': 'req-8531c605-18a8-4908-a996-b5aa6336ed02'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.538418 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b6eb1791c44abb901fd68247590d5f', 'request_id': 'req-8531c605-18a8-4908-a996-b5aa6336ed02'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.546947 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b6eb1791c44abb901fd68247590d5f', 'request_id': 'req-8531c605-18a8-4908-a996-b5aa6336ed02'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.562412 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] The token cache is being invalidate because project 23b6eb1791c44abb901fd68247590d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 00:30:06.562716 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.563567 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.565147 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 519/1030] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 25 00:30:06 2022] DELETE /identity/v3/projects/23b6eb1791c44abb901fd68247590d5f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:30:06.569663 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:06.571283 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:06.586471 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685a08-d1ff-4d94-aee3-e37f9f88f5ef admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:06.659875 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:06.661844 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:06.662322 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:06.662793 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] PATH_INFO: `/v3/users/80bc6f48abf1486e8f63b32dfb37ced9` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:06.664814 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=80bc6f48abf1486e8f63b32dfb37ced9)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:06.667739 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:06.725650 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:06.734518 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80bc6f48abf1486e8f63b32dfb37ced9'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.746092 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80bc6f48abf1486e8f63b32dfb37ced9'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.763168 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80bc6f48abf1486e8f63b32dfb37ced9'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.777744 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80bc6f48abf1486e8f63b32dfb37ced9'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.778550 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-07cfdfc0-c3b6-4b4c-a75c-2cfa1ea7fcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80bc6f48abf1486e8f63b32dfb37ced9'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:06.791214 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 512/1031] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 25 00:30:06 2022] DELETE /identity/v3/users/80bc6f48abf1486e8f63b32dfb37ced9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 00:30:07.025324 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:07.027329 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:07.044673 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c605-18a8-4908-a996-b5aa6336ed02 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:07.145802 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:07.146472 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:07.146753 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:07.147027 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] PATH_INFO: `/v3/projects/884b3c2d448647b3b4f9f0de242730b7` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:07.148232 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884b3c2d448647b3b4f9f0de242730b7)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:07.150182 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:07.215648 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884b3c2d448647b3b4f9f0de242730b7', 'request_id': 'req-d54318be-b289-4f18-b1ff-2aba30f8b071'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:07.223876 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884b3c2d448647b3b4f9f0de242730b7', 'request_id': 'req-d54318be-b289-4f18-b1ff-2aba30f8b071'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:07.232650 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884b3c2d448647b3b4f9f0de242730b7', 'request_id': 'req-d54318be-b289-4f18-b1ff-2aba30f8b071'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:07.246700 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] The token cache is being invalidate because project 884b3c2d448647b3b4f9f0de242730b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 00:30:07.247003 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:07.247699 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:30:07.249340 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 520/1032] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 25 00:30:07 2022] DELETE /identity/v3/projects/884b3c2d448647b3b4f9f0de242730b7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:30:16.781826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:17.243429 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:46.921826 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] REQUEST_METHOD: `POST` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:46.922344 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:46.922429 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:46.942213 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.auth.core [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] MFA Rules not processed for user `0827030802ef47e89eba84d5be4f2803`. Rule list: `[]` (Enabled: `True`). {{(pid=89283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:30:46.943465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:47.003018 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 513/1033] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 25 00:30:46 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:30:47.325803 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:47.327253 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:47.386835 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54318be-b289-4f18-b1ff-2aba30f8b071 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:47.390377 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:47.390976 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:47.391250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:47.391548 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:47.393245 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:47.402923 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:47.404394 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:47.412498 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 521/1034] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:30:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:30:47.862634 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:47.864183 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:47.936240 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60b564-0e15-4d3f-aab8-2c3d83e93301 None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:47.941194 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:47.941831 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:47.942109 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:47.942384 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:47.944104 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:47.956237 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:47.957818 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcbf1f-606b-4fb1-87a3-4350c6aaf582 service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:47.968262 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 514/1035] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:30:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:30:57.408668 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=26 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:57.963367 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=57 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:30:58.980740 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:30:58.983279 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:59.056250 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eabce-76ee-4595-a115-56eeed2c5e94 service neutron] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:30:59.063243 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1a5bdb4170143378833ce36284c2336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:30:59.064102 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:30:59.064391 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:30:59.064668 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:30:59.066414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:30:59.078014 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:30:59.079855 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdaac9-657a-4683-891d-c20791606239 service nova] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:30:59.090573 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 522/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:30:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:31:09.085686 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=32 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:31:53.091997 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d46-5c36-4a29-83aa-1b272deed28f None None] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:31:53.092848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d46-5c36-4a29-83aa-1b272deed28f None None] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:31:53.092848 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d46-5c36-4a29-83aa-1b272deed28f None None] PATH_INFO: `/` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:31:53.094570 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 515/1037] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 25 00:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 00:31:53.100691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] REQUEST_METHOD: `POST` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:31:53.101761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:31:53.101761 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:31:53.145331 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.auth.core [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] MFA Rules not processed for user `cb5fdcf4cde3435d9dfdd4d495ae0558`. Rule list: `[]` (Enabled: `True`). {{(pid=89284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 00:31:53.146596 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:31:53.206350 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 523/1038] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 25 00:31:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 00:31:53.217101 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19d46-5c36-4a29-83aa-1b272deed28f None None] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:31:53.239233 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19d46-5c36-4a29-83aa-1b272deed28f None None] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:31:53.245506 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:31:53.246122 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:31:53.246402 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:31:53.246717 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:31:53.248677 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:31:53.261917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:31:53.263686 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:31:53.275001 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 516/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:31:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:32:03.203414 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=29 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:32:03.270410 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=6 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:33:26.612882 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:33:26.614324 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:33:26.638606 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40cf5a-664a-4207-8abb-ee78b148e136 None None] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:33:26.642231 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac44864c41224ca58e8a489209f878c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:33:26.642872 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] REQUEST_METHOD: `GET` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:33:26.643150 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:33:26.643446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:33:26.645252 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:33:26.731069 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:33:26.732691 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:33:26.742118 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 524/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:33:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:33:33.177293 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:33:33.178970 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:33:33.193239 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d3fba-3540-4d6d-baf2-43b7ecc43e97 service placement] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:33:33.198417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:33:33.199048 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:33:33.199326 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:33:33.199637 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] PATH_INFO: `/v3/users/0827030802ef47e89eba84d5be4f2803` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:33:33.215804 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0827030802ef47e89eba84d5be4f2803)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:33:33.217771 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:33:33.264487 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0827030802ef47e89eba84d5be4f2803'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.272483 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0827030802ef47e89eba84d5be4f2803'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.284435 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0827030802ef47e89eba84d5be4f2803'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.291041 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0827030802ef47e89eba84d5be4f2803'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.291725 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0827030802ef47e89eba84d5be4f2803'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.297409 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 517/1041] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 25 00:33:33 2022] DELETE /identity/v3/users/0827030802ef47e89eba84d5be4f2803 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:33:33.474992 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:33:33.485493 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6582-6621-420f-89d7-6cb24902eb45 service neutron] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:33:33.543690 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:33:33.544375 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:33:33.544702 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:33:33.545017 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] PATH_INFO: `/v3/projects/717c70fe784047d6891161eb1d023096` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:33:33.556446 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717c70fe784047d6891161eb1d023096)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:33:33.559039 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:33:33.609989 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717c70fe784047d6891161eb1d023096', 'request_id': 'req-27515be9-617e-4e43-b62d-f59239a07116'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.614570 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:33:33.615828 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717c70fe784047d6891161eb1d023096', 'request_id': 'req-27515be9-617e-4e43-b62d-f59239a07116'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.626296 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717c70fe784047d6891161eb1d023096', 'request_id': 'req-27515be9-617e-4e43-b62d-f59239a07116'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.638784 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] The token cache is being invalidate because project 717c70fe784047d6891161eb1d023096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 00:33:33.639075 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.639763 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.641320 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 525/1042] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 25 00:33:33 2022] DELETE /identity/v3/projects/717c70fe784047d6891161eb1d023096 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:33:33.645309 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:33:33.646693 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:33:33.659606 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744c4-6c0d-47bc-849a-862df27be326 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:33:33.715738 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:33:33.716370 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:33:33.716647 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:33:33.716917 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] PATH_INFO: `/v3/users/78985d4e87c24a18976c01624754a370` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:33:33.731408 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78985d4e87c24a18976c01624754a370)` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:33:33.733380 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:33:33.778465 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78985d4e87c24a18976c01624754a370'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.782007 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:33:33.786458 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78985d4e87c24a18976c01624754a370'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.799585 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78985d4e87c24a18976c01624754a370'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.806850 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78985d4e87c24a18976c01624754a370'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.807538 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.notifications [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78985d4e87c24a18976c01624754a370'} {{(pid=89283) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:33.813265 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 518/1043] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 25 00:33:33 2022] DELETE /identity/v3/users/78985d4e87c24a18976c01624754a370 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:33:33.987759 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Authenticating user token {{(pid=89284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:33:33.989364 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.fernet_utils [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:33:34.003114 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515be9-617e-4e43-b62d-f59239a07116 admin admin] Validating token access rules against request {{(pid=89284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:33:34.060896 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1621e081d9274dc6a28173f447bc4436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a29ef887000b41b1862f63176946c6ee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:33:34.061525 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:33:34.061832 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] SCRIPT_NAME: `/identity` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:33:34.062098 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] PATH_INFO: `/v3/projects/d4334e8f46084ca195ac010d7d248d1e` {{(pid=89284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:33:34.072372 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4334e8f46084ca195ac010d7d248d1e)` {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:33:34.074259 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] RBAC: Authorization granted {{(pid=89284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:33:34.121153 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4334e8f46084ca195ac010d7d248d1e', 'request_id': 'req-76737ca6-5522-4413-8772-c7b128414135'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:34.126568 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4334e8f46084ca195ac010d7d248d1e', 'request_id': 'req-76737ca6-5522-4413-8772-c7b128414135'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:34.133073 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4334e8f46084ca195ac010d7d248d1e', 'request_id': 'req-76737ca6-5522-4413-8772-c7b128414135'} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:34.144683 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] The token cache is being invalidate because project d4334e8f46084ca195ac010d7d248d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 00:33:34.144969 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:34.145623 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG keystone.notifications [None req-76737ca6-5522-4413-8772-c7b128414135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 00:33:34.147096 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: [pid: 89284|app: 0|req: 526/1044] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 25 00:33:33 2022] DELETE /identity/v3/projects/d4334e8f46084ca195ac010d7d248d1e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 00:33:43.809869 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:33:44.141807 dv-osbrick-862542-1-ceph devstack@keystone.service[89284]: DEBUG dbcounter [-] [89284] Writing DB stats keystone:SELECT=60,keystone:INSERT=2,keystone:DELETE=8 {{(pid=89284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 00:36:57.032291 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Authenticating user token {{(pid=89283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 00:36:57.034238 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:36:57.127050 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241f4be-04f6-46f5-8a5f-846f66d59a99 admin admin] Validating token access rules against request {{(pid=89283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 00:36:57.195577 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5fdcf4cde3435d9dfdd4d495ae0558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e3856a84cc407da62696542e957775', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 00:36:57.196201 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] REQUEST_METHOD: `GET` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 00:36:57.196482 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] SCRIPT_NAME: `/identity` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 00:36:57.196758 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 00:36:57.198546 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.fernet_utils [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 00:36:57.210772 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 00:36:57.212417 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1175ce8-1c9e-4e2e-a33a-8eddb344daa1 service placement] RBAC: Authorization granted {{(pid=89283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 00:36:57.222684 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: [pid: 89283|app: 0|req: 519/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 25 00:36:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 00:37:07.218457 dv-osbrick-862542-1-ceph devstack@keystone.service[89283]: DEBUG dbcounter [-] [89283] Writing DB stats keystone:SELECT=62 {{(pid=89283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}